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ABSTRACT 

A  class  of  sequential  procedures  for  estimating  the  mean 
of  a  normal  distribution  having  known  variance  from  quantal 
response  data  is  discussed.   This  class  includes  as  special 
members  the  up-and-down  method  and  other  procedures  commonly 
used  in  biological  assay.   A  method  of  evaluating  alterna- 
tive procedures  belonging  to  a  given  subset  of  the  class  is 
presented.   This  method  is  essentially  an  application  of 
Wald's  decision  theory.   A  loss  plus  cost  objective  function 
is  used  and  the  efficiency  of  a  particular  procedure  is 
determined  by  its  ability  to  satisfy  one  of  the  four  cri- 
teria considered.   Criteria  are  discussed  for  use  with  both 
the  expected  value  and  variance  of  the  total  loss,  which 
may  be  determined  from  matrix,  equations  that  are  derived. 
Two  applications  are  given.   The  first  is  an  application  to 
procedures  commonly  used  in  biological  assay.   In  the  second, 
an  application  to  the  elevation  procedure  of  the  precision 
registration  technique  used  by  U.S.  Army  and  Marine  Corps 
field  artillery  units,  it  is  seen  that  under  certain  condi- 
tions, Dixon's  modified  up-and-down  method  strictly  dominates 
the  elevation  procedure  currently  in  use. 
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I.   INTRODUCTION 

The  up-and-down  method  is  an  experimental  procedure  for 
estimating  the  median  of  a  continuous  distribution  function 
G  from  quantal  response  data.   The  procedure,  which  origi- 
nated from  testing  the  sensitivity  of  explosives  to  shock, 
is  applicable  to  experimental  situations  which  deal  with 
continuous  variables  which  cannot  be  measured  [6]. 

The  biological  assay  problem,  for  example,  is  an  appli- 
cation which  has  been  studied  by  Dixon  and  Mood  [6], 
Brownlee,  Hodges,  and  Rosenblatt  [2],  Dixon  [4],  Tsutakawa 
[15]  and  others.   The  objective  in  the  bio-assay  problem  is 
to  determine  the  critical  dose  of  a  drug  above  which  greater 
than  fifty  per  cent  of  the  test  specimens  respond.   As  Dixon 
and  Mood  visualized  the  problem, 

"...  a  critical  dose  is  associated  with  each  insect 
(test  specimen),  but  one  cannot  measure  it.   He  can 
only  try  some  dose  and  observe  whether  or  not  the 
critical  dose  for  that  insect  is  less  than  or 
greater  than  the  chosen  dose."  [6]. 

In  performing  a  bio-assay  experiment  a  prescribed  number 

of  specimens  is  usually  tested  at  each  of  several  fixed  dose 

levels.   If  the  up-and-down  method,  originally  studied  by 

Dixon  and  Mood,  is  used,  some  initial  dose  level  in  a  set  of 

equally  spaced  dose  levels  is  chosen  for  testing  the  first 

specimen.   The  next  specimen  is  tested  at  the  dose  level 

immediately  below  or  above  the  dose  level  of  the  previous 

test  depending  upon  whether  there  was  or  was  not  a  response 


on  the  previous  test,  and  so  forth  [5].   Note  the  structure 
of  this  procedure.   A  trial  is  performed  using  one  specimen. 
After  the  initial  trial,  the  level  used  in  succeeding  trials 
of  the  experiment  is  determined  by  the  response  from  the 
preceeding  trial.   Tsutakawa  [15]  studied  a  generalization 
of  the  up-and-down  method  in  which  the  number  of  specimens 
tested  per  trial  is  a  constant  which  is  at  least  one.   In 
the  first  trial  of  Tsutakawa' s  procedure,  which  he  calls  a 
"random  walk  design",  a  group  of  k  >  1  observations  (that 
is,  k  >_  1  specimens  are  tested)  is  made  at  some  level  Y,  in 
a  set  of  equally  spaced  levels.   Here,  each  observation  in 
a  trial  is  a  response  or  nonresponse  depending  upon  whether 
the  value  of  the  random  variable  having  distribution  G  is 
less  than  or  greater  than  some  known  value;  that  is,  if  the 
specimen  responds,  then  it  is  inferred  that  the  critical 
value  (the  median  of  G)  is  less  than  the  value  used  to  test 
the  specimen.   Succeeding  trials  of  the  experiment  are  made 
at  levels  Yp,...,  Y  *,  with  k  observations  per  trial,  deter- 
mined by: 


Yt  +  m   if   0  <  J  <_   k° 

■  <  Y+.      if  k°  <  Jf  <  k  -  k°,  t 

0 


t  +  1  "  >  *t      ±l      K  *ut 


'v  Yt  -  m   if  k  -kw  <  Jt  <  k 

where  m  is  the  interval  between  successive  levels,  J,  is 
the  number  of  responses  on  the  t-th  trial,  and  k°  is  a 
predetermined  integer  such  that  0  <  k°  <  k  -  k°.   This 
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procedure  generates  the  sequence  {Y,  ,  J,  }  and  is  designated 
W(kj  k  )  by  Tsutakawa.   Note  the  differences  between  the 
up-and-down  method  and  W(k,  k  ).   In  the  latter,  a  trial  is 
performed  using  k  specimens  and  the  level  used  in  succeeding 
trials  of  the  experiment  is  determined  by  the  number  of 
responses  from  the  preceeding  trial.   Notice  also  that  the 
design  W(l,  0)  is  identically  the  up-and-down  method. 

The  procedures  of  concern  in  this  study  are  sequential 
sampling  procedures  for  estimating  the  mean  of  G.   The 
purpose  of  this  study  is  twofold:   to  extend  Tsutakawa' s 
procedures,  and  to  formulate  a  metholology  for  evaluating 
alternative  procedures.   The  procedures  to  be  studied  differ 
from  Tsutakawa' s  procedures,  W(k,  k  )  in  that: 

1)  It  is  assumed  that  G  is  a  normal  distribution 
having  known  variance. 

2)  It  is  assumed  that  Tfj   ,  a  set  of  equally  spaced 
levels,  is  finite. 

3)  The  number  N*  of  trials  taken  in  the  experiment 
is  a  random  variable. 

4)  The  number  k  of  observations  taken  per  trial  is 
not  necessarily  constant  throughout  the  experi- 
ment . 

5)  Successive  trials  of  the  experiment  are  not 
necessarily  performed  at  successive  levels 
in  77?  .1 


In  discussing  his  results,  Tsutakawa  [151  suggests 
that  the  experimental  situation  may  prompt  a  widening  of 
his  class  of  procedures  wherein  k  and  m  in  equation  1 
are  permitted  to  vary.   The  properties  4)  and  5)  above 
permit  such  variations. 
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Thus,  if  7/7  is  a  finite  set  of  equally  spaced  levels,  then 
(Z  ,  the  class  of  procedures  to  be  studied,  is  defined  as  a 
class  of  procedures  for  estimating  the  mean  of  a  normal 
distribution,  having  known  variance,  from  quantal  response 
data  which  have  the  properties  3)>  *0  and  5)  given  above. 
When  both  4)  and  5)  are  restricted  (that  is,  k  is  constant 
and  successive  trials  are  performed  at  successive  levels), 
then  Tsutakawa's  procedures,  W(k,  k  ),  belong  to  C  ,  a 
case  which  is  discussed  separately  as  a  special  case  of 
the  general  procedure  in  G>   . 

It  is  assumed  that  the  experimenter  has  selected  a 
nominal  sample  size  or  a  nominal  number  of  trials  for  the 
experiment  and  can  select  a  set  of  equally  spaced  levels 
(this  set  is  a  subset  of  77))    for  the  experiment  which 
include  the  mean  of  G.   Here,  the  term  "nominal"  is  used  in 
the  same  sense  as  used  by  Dixon  [4];  that  is,  as  first 
suggested  by  Brownlee,  et_  a_l  [2],  some  of  the  observations, 
usually  a  string  of  responses  or  nonresponses ,  are  discarded 
as  being  indicative  of  a  poorly  selected  initial  level.   To 
perform  an  experiment  using  the  general  procedure,  the 
experimenter  selects  a  stopping  rule  which  depends  upon 
the  sequence  of  responses.   He  chooses  the  interval  between 
trials;  that  is,  whether  successive  trials  are  to  be  per- 
formed at  successive  levels  or  at  irregular  levels.   For 
example,  he  may  desire  that  the  spacing  between  trials 
decrease  when  the  responses  obtained  indicate  he  is  testing 
near  the  mean.   He  then  decides  upon  the  number  of 
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observations  per  trial  to  be  taken  and  the  observation/ 
response  combinations  which  determine  whether  the  next 
trial  will  be  performed  at  a  higher  level,  a  lower  level, 
or  the  same  level.   For  instance,  in  the  up-and-down  method 
the  observation/response  combinations  are  1/0  and  1/1.   In 
the  first  case,  the  next  trial  would  be  performed  at  a 
higher  level;  while  in  the  second  case,  it  would  be  per- 
formed at  a  lower  level.   These  choices  can  be  made  in 
advance  because  the  experimenter  knows  the  nominal  sample 
size.   After  experimentation,  the  estimate  of  the  mean  is 
determined  using  one  of  several  estimators. 

The  general  procedure  is  evaluated  by  representing  the 
estimate  of  the  mean,  derived  by  use  of  the  procedure,  as 
the  level  nearest  the  estimate.   This  is  an  approximate 
representation  which  can  be  made  as  accurate  as  one  pleases 
by  increasing  the  number  of  levels  while  decreasing  the 
spacing  between  levels.   Thus,  the  total  loss,  in  deciding 
the  estimate  is  at  a  particular  level,  can  be  taken  as  the 
loss  associated  with  deciding  that  it  is  at  some  level  plus 
the  cost  of  sampling.   Hence,  the  problem  of  determining 
an  optimal  procedure  W*  in  V ,  a  set  of  procedures  in  ^    under 
consideration,  is  the  decision  problem  formulated  by  Wald 
[17].   Matrix  equation,  derived  for  the  expected  value  and 

variance  of  the  total  loss,  are  used  with  one  of  four  cri- 

2 
teria  discussed  to  determine  the  optimal  procedure.    The 


2 
This  approach  was  suggested  by  the  approach  used  in 

a  report  by  Elfving  [14]. 
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criteria  considered  consist  of  the  usual  Bayes  and  minimax 
criteria  used  in  conjunction  with  the  expression  for  the 
expected  loss.   In  addition,  two  analogously  defined 
criteria  are  used  in  conjunction  with  the  expression  for 
the  variance  of  the  loss.   In  the  special  case,  it  is  shown 
that  choosing  the  number  k*,  of  observations  per  trial 
which  minimizes  the  expected  value  of  the  total  loss  is 
equivalent  to  finding  a  procedure  which  satisfies  the  Bayes 
criterion. 

The  present  study  was  motivated  by  a  gunnery  problem 
encountered  by  U.S.  Army  and  Marine  Corps  field  artillery 
units.   The  problem  is  that  of  determining  a  basis  for 
corrections  to  an  element  of  firing  data  called  elevation. 
Here,  elevation  is  an  angle  to  which  a  gun  tube  must  be 
raised  In  order  that  the  center  of  impact  of  a  group  of 
projectiles  fired  from  the  tube  will  be  at  a  given  distance, 
called  the  range,  from  the  gun.   The  procedure,  currently 
used  to  determine  the  adjusted  elevation,  is  known  as  the 
elevation  procedure  of  the  field  artillery  registration 
technique.   While  the  origin  of  the  current  procedure  is 
obscure,  it  is  known  to  have  evolved  from  earlier  procedures 
in  use  since  World  War  II.   After  an  adjustment  phase  in 
which  the  center  of  impact  is  moved  near  a  known  point 
referred  to  as  the  registration  point,  the  procedure  essen- 
tially consists  of:   observing  whether  a  projectile  bursts 
beyond  or  short  of  the  registration  point;  then,  changing 
the  elevation  setting  after  a  prescribed  sequence  of 


m 


responses  have  been  observed.   This  pattern  of  experimen- 
tation is  continued  until  a  nominal  sample  size  of  six 
bursts  have  been  observed.   Then,  the  adjusted  elevation 
is  computed. 

Notice  the  similarity  in  the  problem  of  determining 
the  adjusted  elevation  and  the  bio-assay  problem.   Para- 
phrasing Dixon  and  Mood,  an  adjusted  elevation  is  associated 
with  each  registration  point,  but  one  cannot  measure  it. 
He  can  only  try  some  elevation  setting  and  observe  whether 
the  projectile  bursts  beyond  or  short  of  the  registration 
point,  that  is,  observe  whether  the  adjusted  elevation  is 
less  than  or  greater  than  the  chosen  elevation  setting. 

It  was  discovered  that  Tsutakawa's  procedures,  which 
include  an  earlier  version  of  the  elevation  procedure,  do 
not  include  the  procedure  currently  in  use  because  of  pro- 
perties 4)  and  5)  listed  above  for  procedures  in  the  class 
<-Z   •   Thus  in  order  to  evaluate  the  current  procedure  and 
some  alternative  procedures,  it  was  necessary  to  consider 
a  wider  class  of  procedures. 

The  reader  interested  primarily  in  the  application  to 
the  elevation  procedure  of  the  precision  registration  tech- 
nique may  omit  Sections  IIB  and  IIIC.   The  reader  interested 
in  the  more  general  aspects  of  the  problem  may  omit  Section 
IIIC-2  and  Chapter  IV. 
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II.   THE  GENERAL  PROCEDURE 

An  extension  of  Tsutakawa's  procedures  will  now  be  made 
precise.   Let  "W  =  {...,  m_,  ,  m_  ,  m,  ,...}  be  a  set  of 
equally  spaced  levels  with  interval  m  where  the  m.  are  mid- 
points of  the  set  of  intervals 


2  »  2 


'  ^m  ml  fin  3m \ 
2,232'2l,,"*  \e- ) 


For  later  convenience,  let  m_  be  the  mean  of  G.   Let  779",  a 
finite  subset  of  7^'  containing  m  ,  be  known  to  the  experi- 
menter; that  is,  assume  that  the  experimenter  has  sufficient 
knowledge  of  the  random  variable  having  distribution  G  to 
select  a  subset  of  the  levels  of  IT)'    for  the  experiment 
which  contains  m  .   This  can  be  done  without  serious  loss 
of  generality  because  the  variance  of  G  is  known  and  the 
experimenter  need  not  know  the  specific  level  in  77Q"which 
is  nig  .   It  is  further  assumed  that  the  experiment  begins  at 
some  randomly  selected  level  in  777"  but,  in  general,  some 
of  the  trials  of  the  experiment  may  be  performed  at  levels 
not  in  7)Y''      Thus,  in  the  experiment  described  below,  a 
random  number  N*  of  trials  is  performed  at  the  levels  in 

in'. 

In  the  general  procedure,  the  first  trial  of  the  experi- 
ment is  performed  at  level  Y,  in  jn"  where  a  set  of  k, 
observations  are  taken.   On  the  nH  -  1  succeeding  trials  of 
the  experiment,  kp,...,  k  *  observations  are  taken  at  levels 
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Y„,...,  Y  *  determined  by: 

2 '    '   n 

f  Y  +  C.'m  if   0  <Jt  <  k  ° 

Yt  +  1  =   Yt        lf  kt0<  Jt<kt"kt°  •  t^1  (3) 

Yt  "  Vmif   kt"kt°<Jt±kt 

where  {C,  :  C,  -  1  <_  C,  ,,  <  C,  +  1}   is  a  sequence  of  pre- 
determined integers  which  determine  the  spacing  between 
levels  at  which  trials  are  performed;  {k  }  is  a  sequence 
of  predetermined  integers  which  determines  the  number  of 
observations  per  trial;  {k,  }  is  a  sequence  of  predeter- 
mined integers  such  that  0  <_  k,   <  k,  -  k,  ;  and  J,  is  the 
number  of  responses  on  the  t-th  trial.   Thus,  the  experi- 
menter selects  a  level  in  ;/•."'  for  the  first  trial  of  the 
experiment.   Succeeding  trials  are  performed  at  levels 
determined  by  use  of  the  sequences  {C  },  {k  },  and  {k,  } 
which  are  known  to  the  experimenter  and  J,  which  the 
experimenter  observes.   Each  observation  is  a  response  or 
nonresponse  depending  upon  whether  the  value  of  the  random 
variable  having  the  normal  distribution  G  is  less  than  or 
greater  than  some  known  value. 

The  number  N*  of  trials  of  the  experiment  is  determined 
by  use  of  a  stopping  rule  6.   Here,  the  set  of  stopping 
rules  under  consideration  is  such  that  N*  is  finite  and  a 
particular  rule  6  depends  upon  the  sequence  {J,  }  in  a 
manner  similar  to  that  suggested  by  Brownlee,  et  al  [2]  and 


3 
The  restriction  on  {C, }  is  discussed  below 
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used  by  Dixon  [H]    in  his  study  of  the  up-and-down  method 
for  small  sample  sizes.   For  example,  if  k   =  1  for  all  t, 
then  a  typical  rule  6  might  be  to  perform  six  trials  of 
the  experiment  after  the  first  reversal  (that  is,  first 
response  after  a  string  of  nonresponses ,  or  vice  versa) 
in  the  sequence  {J.  }.   Thus,  for  a  given  performance  of 
the  experiment,  the  number  N  of  observations  is  determined 
by  the  rule  6  and  the  sequence  {k,  }  from 

N* 
N  =   Z   k,  .  (4) 

t=l  z 

The  general  procedure  described  above  generates  the 

sequence  {Y,  },  which  forms  a  random  walk  on  the  levels  in 

7?)',    and  determines  N.   The  general  procedure  is  a  modified 

Tsutakawa  random  walk  procedure  and  will  be  designated 

W(<5,  k ,  ,  k,  ,  C.  )  or  simply  W  when  no  confusion  results 

from  the  abbreviation.   Notice  the  differences  between 

Tsutakawa's  W(k,  k°)  and  W(6,  kt ,  kt°,  C.).   Instead  of 

a  fixed  number  of  observations,  the  latter  uses  a  stopping 

rule  to  determine  the  number  of  observations.   Sequences 

rather  than  constants  are  used  in  W(6,  k  ,  k  °,  C,  )  to 

t    t     k 

determine  the  level  of  each  trial,  the  spacing  between 
levels  used  for  successive  trials  and  the  number  of  obser- 
vations per  trial.   Notice  also  that  the  procedure 
W(6,  kt,  kt°,  Ct)  =  W(6,  k,  k° ,  1)  is  identical  to  Tsuta- 
kawa's procedure  W(k,  k°)  except  for  the  rule  6,  which  has 
been  incorporated  into  the  former.   Procedures  of  the  type 
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W(6,  kj  k  3  1)  will  be  referred  to  as  a  special  case  of  the 
general  procedure  in  J   and  will  be  discussed  separately 
below. 

In  the  above,  the  general  procedure  has  been  described 
with  the  performance  of  an  experiment  in  mind.   That  Is, 
the  information  known  to  the  experimenter  has  been  given 
and  the  procedure  he  should  follow  has  been  outlined.   In 
that  which  follows,  the  discussion  will  begin  to  focus  on 
the  second  purpose  of  the  study — to  formulate  a  methodology 
for  evaluating  alternative  procedures  In  *  .   Here,  it  is 
convenient  to  view  the  general  procedure  from  the  stand- 
point of  an  experimenter  interested  in  determining  which 
procedure  among  a  set  of  alternative  procedures  in  the  class 
is  best.    When  viewed  in  this  light,  the  general  procedure 
can  be  characterized  by  two  stochastic  matrices  which 
facilitate  the  evaluation. 

A.   TWO  MATRICES  WHICH  CHARACTERIZE  THE  GENERAL  PROCEDURE 
If  a  single  observation  is  made  of  the  random  variable 

having  distribution  G,  then  a.  and  8.,  the  probabilities 

1"  h  " 

of  response  and  nonresponse  at  the  i    level  in  h)     ,    are 


a1=G(mi)=l-81;i=0,  ±1,...   .  (5) 

Note  that  if  i  =  0,  then  a   =  G(m  )  =  0.5  =  3Q.   Also,  it  is 
clear  from  the  symmentry  of  G  that  there  exists  levels  in 


4 
The  sense  in  which  a  procedure  is  best  or  optimal  will 

be  clarified  below.   The  term  efficiency  is  also  used  to 

mean  the  degree  of  optimality  of  a  procedure. 
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Tfl ' ,  equidistant  from  m0  ,  say  m   and  m  ,  such  that 

a   =  G(m   )  =  0,  (6) 

-u      -u     ' 

a   =  G(m  )  =  1, 

u      u      * 

so  that  levels  m   and  m  may  be  taken  as  reflecting 

-u      u   a  & 

barriers.   Let  771    be  such  a  subset  of  YD';    that  is,  let 

77]   =  {m   ,  .  .  .  ,  m„  ,  .  .  .  ,  m  }  where  the  index  u  is  chosen  such 
-u3         *   0 '         *   u 

that  7)0  ^>  the  set  of  levels  known  to  the  experimenter,  is 
contained  in  J71 .   Thus,  it  follows  that  the  experiment 

begins  at  some  randomly  selected  level  in  Jfj  .   Note  however 

t  h 
that  if  Ct  ¥   1  for  some  t,  then  the  (t+1)    trial  of  the 

experiment  may  be  performed  at  some  level  not  in  7)1 .   Sup- 
pose, for  example  that  the  t-th  trial  is  performed  at 
level  m  -,  and  that  C,  =  v,  v  ^  1.   Then  it  is  possible 

that  the  (t+l)th  trial  will  be  performed  at  level  m    , , 

y  u+v-1* 

a  level  which  is  outside  the  reflecting  barrier  at  level 
m  .   To  get  around  this  difficulty,   all  the  levels  outside 
m_u  and  m  may  also  be  taken  as  reflecting  barriers  and 
the  restriction,  C,  -  1  <_  C.  ,  <_  C,  +  1,  imposed  on  the 
sequence  {C^}.   Under  these  assumptions,  it  follows  that 
the  sequence  {Y,  }  cannot  contain  two  successive  levels  not 
in  77)  . 

When  the  experiment  ends,  the  experimenter  may  compute 
an  estimate  of  the  mean  of  G,  say  m  ,  using  one  of  several 


5 

^Note  that  this  difficulty  does  not  exist  in  the  special 
case  where  C.  =  1  for  all  t. 
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estimators  which  will  be  generically  denoted  Y.   This  com- 
putation may  be  performed  using  all  or  part  of  the  data  in 
the  sequence  {Y  ,  J  }  together  with  N,  N*,  and  m.   Now 
mn  is  in  one  of  the  intervals  of  ^i  ,  given  by  equation  2, 
the  midpoint  of  which  is  given  by  one  of  the  levels  in///"; 
that  is,  m  may  be  represented  by  one  of  the  levels  in  771 " . 
And  since  the  sequence  {Y, }  cannot  contain  two  successive 
levels  not  in  7) )  ,  it  is  reasonable  to  assume  in  the  general 
procedure  that  m„  may  be  represented  by  one  of  levels  in 
7)0.      This  assumption  is  not  necessary  in  the  special  case 
because  there  Y,  is  in  7/1    for  all  t.   Thus,  when  it  is  said 
that  the  experiment  ends  at  a  level  in  77)  3    it  is  meant  that 
mn  is  in  ///. 

The  sequence  {Y,}  generated  by  W  can  be  classified  as 
an  integer  valued  discrete  time  stochastic  process  having 
state  space  7Yl'   =    {...,  -1,  0,  1,...}  and  parameter  space 
T '=  {1,  2,...}  where  in  77)  " ,  m  =  0  and  the  interval  m  =  1. 
Expressions  for  the  one-step  transition  probabilities  that, 
on  the  (t+l)^h  trial  of  the  experiment,  the  process  goes 
up  a  level,   remains  at  the  same  level,  or  goes  down  a 
level  may  be  found  using  (3)  and  the  fact  that  J,  is  dis- 
tributed binomially  with  parameters  k,  and  a.,  which  is 
given  by  (5) . 


To  perserve  the  terminology  of  the  up-and-down  method 
the  term  "level"  will  be  used  in  lieu  of  the  term  "state." 


21 


Let 


/  P±     j  =  i  +  C 


t 


'i,j  "< 


r±  j  =  1 


q±     j  =  i  -  Ct 
^  0     otherwise 


(i  =  0,  ±1,...)       (7) 


denote  the  probability  that  the  process  goes  to  the  j-th 
level  on  the  (t+1)  trial  given  it  was  at  the  i-th  level 
on  the  t-th  trial.   Then  it  follows  from  (3)  that 

0     kt    Ik]        k  -j 

r±  =  Pr(kt°<Jt<kt-kt°)  =  ^   o^  [  /j  a{   g±        (8) 

kt    fk,\  , 

q.  =  Pr(k, -k  °<J, <k,  )  =    £     !  ?   <  3,  t~J 
1       t   t  -  t-  t   J=kt_kt°  \  J  /   i   i 


where   P^O,  rj_  >_0 ,  q.j>0  and  p.  +  r.+q.  =  1;  i  =  0,±1, 


•  •      * 


Now  consider  the  triplet  (7/),   W,  Y).   Let  rrf ',  determined 
by  use  of  Y,  be  represented  by  one  of  the  levels  in  777. 
Recall  that  when  the  experiment  is  performed,  sampling 
begins  at  some  level  in  7/1 .   Now  the  actual  level  in  7V    at 
which  sampling  begins  is  a  random  variable,  say  Q,  which 
depends  upon  prior  knowledge  of  the  experimental  situation. 
Likewise  the  level  in  77)    which  represents  m   is  also  a  random 
variable,  say  M,  which  depends  on  W,  G,  and  Y.   Given  the 
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triplet  (7)1,    W,  Y),  the  joint  probability  that  M  =  j  c"W  and 
N  =  n,  given  Q  =  lei}),    denoted  by 

fM,N|Q  (jj  nl1)(1>  J=0>  ••'  ±u;n=  nL,.  .  .  ^ny),    (9) 

can  be  found  using  equations  8.   Here  nT  and  n,.,  the  lower 
and  upper  bounds,  respectively,  on  the  number  N  of  observa- 
tions are  finite  for  a  given  stopping  rule  6  because  N*  is 
finite.   Equation  9  is  an  expression  for  the  probability 
that  the  experiment  ends  at  level  jeT)")    after  n  observations, 
given  the  experiment  begins  at  level  ieTJty.   Let  I    =  2u  +  1 
be  the  total  number  of  levels  in  ?)) .      Denote  by 

aii  =  gM|Q  (J'l1^  l     fM,N|Q  U>    n'i)s  (10) 

the  conditional  probability  that  the  experiment  ends  at 
level  j  given  it  begins  at  level  i.   Then  A  =  (a..)  is  a 
£  x  £  stochastic  matrix  which  will  be  referred  to  as  the 
Procedure  Transition  Matrix.   Similarly,  denote  by 

u 
bij  =  gN|Q  (j|i)  =   Z   fM,N|Q  (m'  J''1}'  (11) 

the  conditional  probability  that  the  experiment  ends  after 
j  observations  given  it  begins  at  level  i.   Then  B  =  (b..) 
is  a  £  x  (nTJ  -  nT  +1)  stochastic  matrix  which  will  be  referred 
to  as  the  Procedure  Iteration  Matrix.   It  will  be  shown 
below  that  the  matrices  A  and  B  characterize  procedures 
in  £  . 
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B.   A  SPECIAL  CASE 

Consider  the  special  cases  W(6,  k,,  k,  ,  c+-)  =  w^»  k,  k  ,  1) 
in  (?  .   In  dealing  with  these  cases,  it  will  be  convenient 
to  work  with  the  random  variable  N*,  the  number  of  trials, 
rather  than  N  the  number  of  observations.   Since  k,  =  k  for 
all  t,  N,  which  is  easily  obtained  from  (4),  becomes 

N  =  k  N*.  (12) 

This  change  is  made  to  permit  easy  comparison  among  pro- 
cedures having  a  different  number  k  of  observations  per 
trial.   Since  C,  =  1  for  all  t,  all  the  levels  in  ID    are 
accessible  from  any  level  in  7Y)   in  a  finite  number  of  trials 
(that  is,  all  the  levels  communicate  with  each  other). 
Moreover,  the  probability  that  a  particular  level  in  77)   is 
selected  for  the  (t+1)    trial  depends  only  on  the  level 
used  and  the  response  obtained  on  the  t-th  trial.   Hence, 
the  stochastic  process  {Y,  ;  t>_l}  generated  by  W(6,  k,  k,  1) 
has  U]  as  Its  state  space,  forms  a  random  walk  on  YY)   between 
reflecting  barriers  at  levels  -u  and  u  and  is  thus  a  finite, 
irreducible  Markov  chain.' 

In  particular,  the  elements  of  the  1   x  I   one-step 
transition  probability  matrix  P  =  (p..)  are  given  by  (7) 
where  from  (8) 


7 
The  terminology  used  in  classifying  the  chain  correS' 

ponds  to  that  used  by  Cox  and  Miller  [3]  and  Karlin  [11]. 
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f  1  I=-u 

k° 

p.  =     Z  k:  a.J"  3.k_J*        i=-u+l.  .  .  .  ,u-l 

J  =  0  !Ji    X    X 

0  i  =  u 


/ 


k-k°-l 


r   =     Z      I  ki  a.J*  3.k  J"     i=-u+l,.  .  .  ,u-l        (13) 
i     j=k°+l  1  J I      x    x 

0  i=±u 


f  0 


1  =  -U 


k 
Z 
j=k-kl 


q   =     Z      i    a  d  3.        i=-u+l, . . . ,u-l 


1  =  U 


and  use  has  been  made  of  equations  6  for  i = ±u.   Thus,  P 
has  positive  elements  only  on  its  principal  diagonal  and 
the  diagonals  just  above  and  below  the  principal  diagonal; 
that  is j  P  is  of  the  form 
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p  = 


q-u+l  r-u+l  p-u+l 


qo    r0    P0 


qu-l   ru-l   Pu-1 


0     1 


where  the  (£-2)  x  (£-2)  sub-matrix  of  P  which  excludes 
the  first  and  last  rows  and  columns  of  P  is  a  matrix  of 
Jacobi  [8].   Furthermore,  it  follows  from  (5)  and  the 
symmetry  of  G  that  a_±    =    3  •  and  thus  p_.  =  q    r   =  r. 
and  q_±    ~   p±    (i  =  0,±1, . . . ,±u) .   With  these  results  the 
matrix  P  can  be  rewritten 
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p  -i      ?     i      q  n 

*U-1     U-l    MU-1 


P  = 


p0    ro    po 


(14) 


q  n  r  i  p  i 

^u-l    u-l   *u-l 


ii 


Note  that  P  has  the  property  that  if  the  elements  above  the 
secondary  diagonal  are  transposed,  the  resulting  matrix  is 
symmetric  with  respect  to  the  secondary  diagonal.   This 
property  will  be  referred  to  as  reflective  symmetry  about 
the  center  element  r„  .   Note  that  if  k  =1,  then  k  =  0  by 
definition  and  it  follows  from  (8)  that 


r.  =  P  (0<J,<1)  =  0 
l     r     t 


for  i  =  0,±1,  ...±(u-l).   Thus  when  k=  1  the  principal 
diagonal  of  P  contains  all  zeros. 

The  stochastic  process  (Y,  ;  t_>l}  can  now  be  further 
classified  for  k>l.   To  determine  the  periodicity  of  the 
chain,  it  is  sufficient  to  consider  the  elements  r.  in  P 
and  the  level  0  [11].   When  k  =  1,  r.  =0  for  all  i,  and 
the  chain  has  period  two  since  a  return  to  the  starting 
level  is  possible  only  in  an  even  number  of  trials.   When 
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k>l,  rn>0  and  the  chain  is  aperiodic  since  the  process  can 
reach  level  0  and  remain  there  indefinitely  regardless  of 
its  initial  level  in  TY) .   The  chain  is  necessarily  positive- 
recurrent  because  its  state  space  7f)  is  finite;  that  is,  the 
probability  that  the  process  returns  to  level  i  after  a 
finite  number  of  trials  is  one.   Hence  the  stochastic  process 
{Y.;  t>l}  formed  by  W(6,  k,  k°,  1)  is  completely  classified. 
For  k>l,  the  process  is  a  finite,  irreducible,  aperiodic 

o 

Markov  chain   and  hence  stationary  probabilities  can  be 
found  for  the  chain. 

It  was  mentioned  earlier  that  one  may  wish  to  compare 
procedures  of  the  special  case  having  a  different  number  k, 
of  observations  per  trial.   With  this  in  mind  as  an  eventual 
objective,  the  asymptotic  property  of  the  P  matrix  as  k 
increases  is  next  considered.   Note  that  (14)  can  be  written 


0 


0 


p, 


i-p„_i-q 


u-l  ■"■  *u-l  Mu-1  Mu-1 


Pr 


l-2p, 


lu-l 


i-pu_i-qu_iPu_i 

1        0 


(15) 


o 
If  a  chain  is  both  positive-recurrent  and  aperiodic 
it  is  said  to  be  ergodic  [33.   Kemeny  and  Snell  [12]  call 
a  chain  of  this  type  a  regular  Markov  chain. 
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and  from  (13)  >  for  k  <0°,  it  is  seen  that 


lim        lim        „ 
k+°°   pi    k+°°   qi 


Hence , 


°ol    o|  ° 


lim  P  _  ; 


0    I      0   ; =   P*  (16) 

0   0 


10 
10 


where  I  is  a  (l-k)    x  (Z-H)    identity  matrix.   Intuitatively , 
this  limit  property  implies  that  as  the  number  k,  of 
observations  increase  without  bound,  the  probability  that 
the  process  (Y,  ;  t^_l)  remains  at  its  starting  level  is  one, 
for  1=0,  ±1,...,  ±(u-l).   This  can  also  be  seen  from  (3) 
by  noting  that 


lim   n   ,.,     v  N    lim   _,   ,.  o.T    ..         .  o>.    1 
k.oo   P^  (Yt  +  1=  Yt)  =  k_   Pr  (k  <Jt<k  -  k  )  =  1 


In  the  two  sections  which  follow,  the  properties  of  the 
A  and  B  matrices  introduced  earlier  will  be  considered. 
First,  changes  as  a  consequence  of  (12)  will  be  noted.   Then 
the  asymptotic  properties  of  the  A  and  B  matrices  as  k 
increases  without  bound  will  be  considered  for  a  specific 
example . 

1.   The  A  and  B  Matrices 

The  Procedure  Transition  and  Iteration  Matrices  in 
the  special  cases  are  found  in  a  manner  analagous  to  that 
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used  above.   The  resulting  expressions  can  be  obtained  by 
replacing  N  by  N*  in  (9)-(ll).   The  i-th  row  of  A  is,  as  in 
the  general  case,  the  conditional  probability  that  the 
experiment  ends  at  level  j  given  it  begins  at  level  i;  while 
in  this  case,  the  i-th  row  of  B  is  the  conditional  prob- 
ability that  the  experiment  ends  after  j  trials  given  it 
begins  at  level  i. 

2.   Properties  of  the  A  and  B  Matrices  Given  the 
Triplet  (77),  W,  y") 

As  a  result  of  the  fact  that  the  stochastic  process 
{Yt;  t>l}  generated  by  W(6,  k,  k°,  1)  is  a  finite,  irredu- 
cible Markov  chain  and  the  parameters  k  and  k°  are  constant 
for  any  particular  W,  the  A  and  B  matrices  can  be  further 
studied  to  determine  their  asymptotic  properties  as  the 
number  k  of  observations  per  trial  for  a  given  triplet 
(Ttf,  W,  Y). 

Consider  the  set  of  procedures,  T      in  <Z>    defined  by 
W(6,  k,  k  ,  1)  =  W(51,  k,  0,  1)  where  the  rule  6±    is  to 
stop  the  experiment  after  both  responses  and  nonresponses 
have  been  observed  on  two  successive  trials.   For  simplicity, 
let  7n    =  {-2,  -1,  0,  1,  2}.   Then  I   =  5;  m  =  1;  n*   =  2; 
and,  since  it  is  possible  to  start  the  experiment  at  level 
-2  and  not  obtain  a  response  until  level  2  is  reached, 
n^y  =  5.   Prom  (15)  the  one-step  transition  probability 
matrix  P  is 
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p  = 


-2 

-1 

0 

1 

2 

2 

0 

1 

0 

0 

0 

1  pi 

1- 

-pr 

•ql 

ql 

0 

0 

0       0 

Po 

1-2P(J 

Po 

0 

1       0 

0 

ql 

1- 

-pl-ql 

pl 

2 

0 

0 

0 

1 

0 

(17) 


where    from    (3),    (8)    and    (13)    for   k°    =    0, 


P0    =    Pr(Yt+l   =  ±XlYt    =    0)    =    eo 


k 


Pl   =    Pr(Yt+l    =  ±2lYt    "    ±1}    "    3 


ql   =    Pr(Yt+l    =    °lYt    =   ±1)    =    al 


Pr(Y  =    ±l|Yt    =  ±2)    =    1 


To  determine  the  probability  fM  m*|q  that  the  expert 
ment  ends  at  level  M  after  N*  trials  given  it  started  at 
level  Q,  it  is  convenient  to  first  consider  which  combi- 
nations  of  levels  and  responses  are  required  by  Y  to  place 
rru  at  a  particular  level  in  ?/)  .   Here,  the  estimator, 


n' 


m 
Y  =  ^   Z      Y,  -  ^   I      J,  +  m, 

d    t=n*-l  Z        *  t=n*-l  Z 


(18) 


from  the  elevation  procedure  of  the  field  artillery  pre- 
cision registration  technique  (discussed  further  in  IV)  will 
be  used.   Note  that  the  estimator  (18)  requires  data  from 
only  the  last  two  trials,  the  same  number  of  trials 
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specified  by  the  stopping  rule;  that  is,  the  mean  is  com- 
puted from  the  data  obtained  from  trials  at  two  successive 
levels  in  W  which  result  in  both  responses  and  nonresponses . 
Note  also  that  in  case  there  are  k  total  responses,  then 
(18)  reduces  to  the  mean  level  tested  on  the  last  two 
trials.   Next,  recall  that  the  set  of  levels  W  represents 
the  midpoints  of  a  finite  set  of  disjoint  intervals  of 
equal  length  m,  where  the  level  0  (the  mean  of  G)  repre- 
sents the  midpoint  of  an  open  interval  and  the  remaining 
intervals  are  half-open.   Here,  since  m  =  1,  7Y)    =  {-2,..., 2} 
represents  the  set  of  intervals, 


J  = 


V 


zl      =1 

2      »  2 


=  3   zl 

2  s  2 


Nl   1 
I  2  »  2   ' 


1  i 

2  »  2 


2   5 
»   2  *  2 


(19) 


A  1    1         ~ 

If  m  is  in  the  interval  (- ^  >  j) ,  then  mQ  is  represented  by 

level  0  and  the  random  variable  M  is  zero. 

It  will  now  be  shown  that  sufficient  conditions  for 

determining  the  value  of  M  can  be  given  on  the  total  number 

JT  of  responses  obtained  on  the  last  two  trials.   If  the 

experiment  starts  at  level  0  (that  is,  Q  =  Y,  =  0)  and 

l<J1<k  -  1,  then  it  follows  from  (13)  that  Yp  =  0  since 

=  0.   Also  the  experiment  will  end  in  this  case  after 

two  trials  regardless  of  the  outcome  of  the  second  trial. 

From  (18)  one  can  determine  upper  and  lower  bounds  on  the 

total  number  of  responses  observed  on  the  last  two  trials 
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t=n*-l 


which  are  sufficient  to  determine  the  level  of  m   and  thus, 

o 

M.   That  is;  for  M  =  0  it  must  be  true  that 


-1^1 
—  <  mQ  <  ?  • 


If  Y,  =  0,  and  Yp  =  0  then  it  follows  from  (18)  and  the 
fact  that  N*  =  2  that 


-1       JT       1 

T<  °  "  ~+  x  K   2 


which  implies  that 


<  JT  <  2k  - 


(20) 


where 


k  k 

■p   denotes  the  greatest  integer  in  — .   Similarly 


for  M  =  -1  and  M  =  1 ,  given  Y   =  0  and  Yp  =  0,  it  foil 


ows 


1 1 


<_   JT  <_   2k  -  1  and  1  <  L  < 


k 

L2J 


,  respectively. 

In  a  like  manner  sufficient  conditions  on  J^  for  determining 
M  can  be  found  for  other  outcomes  of  the  experiment  and 
conveniently  displayed  at  the  terminal  branches  a  logic  tree 
such  as  that  shown  at  Figure  1  for  Q  =  0.   It  should  be 
noted  that  the  lower  bound  condition  on  J^  determines  the 
upper  bound  for  M  and  vice  versa.   For  example,  if  Y,  =0 
and  Y„  =  0,  then  using  (18)  and  (20)  one  obtains  for  M  =  0 , 

n    1  I  k  .   1    .,         1    e 

max  m=0---+£+l=--r 
0        k   2  2    k 
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since 


<  —  +  e  <  J_,  for  some  £  >  0,  and 


min  m0  =  0-^(2k-2-£)  +  1=~2  +  k 


k 


since  J^  <  2k  -  p-  -  e    <  2k  - 


k 


tt  ; ,  for  some  e  >  0 


Note  that 

the  number  N*,  of  trials  is  readily  determined  for  each  of 
the  tree  branches. 

The  joint  conditional  probability  fM   si   can  be  deter- 
mined using  diagrams  such  as  Figure  1,  the  P  matrix,  and 
conditional  probability  arguments.   Let  g.  .  be  the  prob- 
ability  that  the  total  number  of  responses  obtained  on  the 
last  two  trials  satisfies  the  sufficient  conditions  for 
M  =  j  given  that  the  last  trial  was  at  level  i.   In  general, 
these  probabilities  are  easily  obtained  except  when  two 

successive  trials  are  conducted  at  the  same  level.   For 

"3    A    5 
instance,  from  Figure  1  note  that  i-  <_   m„  <  ~s  the  condition 

for  M  =  2,  is  satisfied  by  the  upper  most  branch  of  the 

tree;  that  is, 


g2  2  =  Pr(JT  =  k|J2  =  0) 


=  Pr(J^  =  k|J2  =  0)  =  1 


(21) 


And  when  M  =  0,  it  is  seen  that 


35 
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-  - 

r."| 

PrlL2_ 

<  JT  <  2k  - 

|j  1 1  <  jx  <  k  - 1) 

Pr 

k 
_2J 

+  1  <  J1   +   J2  £  2k  - 

"k 

_2j 

-  ll 1  <  J,  <  k-1 

-  1  -    / 

k-1    1 
E   Pr 

-  .1  =  1    * 

k 

_2_ 

+  1  -  j  <  J2  <  2k  - 

V 

2^ 

-  1-  J  1  J-l  =  j) 

Pr(l  <  J-,  <  k  -  1) 


In  a  similar  manner,  one  obtains: 


gx  ]_  =  Pr(l  <  J2  <  k|J1  =  0)  =  1  -  p1, 


(22) 


g 


0,1 


k-1 
I 

=  1=1 


Pr(l  -  j  <_  J2  < 


-  J  I  Jx  =  J) 


Pr(l  <  J,  <  k  -  1) 


g 


0,-1 


k-1 
I   Pr(2k  - 
_  1=1 


-  J  £  J2  I  2k  "  1  "  J  I Ji  =  J) 


Pr(l  <  J1  <  k  -  1) 


(23) 


g_l  _i  =  Pr(0  £  J2  i  k  ~  !|Ji  =  k)  =  1  -  px, 

S_2  -2  =  Pr(J3  =  °IJ2  =  k)  =  !• 

Note  that  the  g,  .,  i^O,  can  be  expressed  in  terms  of  the 
elements  of  the  P  matrix  given  by  (17).   Also,  the  denomi- 
nator of  the  expressions  for  gQ  .,  j  =  -1,  0,  1,  is  by  (13) 
equal  to  r  .   These  two  relationships  were  also  found  to 
hold  when  Q/0.   Note  also  that  gQ  1  and  gQ   .  are  the  tail 
probabilities  of  the  conditional  probability  distribution 
of  the  random  variable  J2  given  the  random  variable  J,  is 
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not  0  or  k  and  that  g.  .  =  g  .   .  ,  1=1,2.   Indeed,  It 

1,1      i >  i 

can  be  shown  from  expressions  similar  to  (20)-(23)  that 

Si,j  =  g-i,-j 
for  i,j  =  0,  ±1,  ±2.   Thus,  the  notation  can  be  eased  some- 
what in  the  discussion  that  follows. 

From  the  Markovian  nature  of  the  procedure  being  studied 
it  follows  that  the  joint  conditional  probability,  fM  „S|Q, 
is   now  easily  written  for  Q=0  using  equations  (21)  through 
(23),  the  elements  of  the  P  matrix  given  by  (17) >  and  Figure 
1.   That  is; 

fM,N*|Q  (2>3|0)  =  g2j2'  Pr(Y3=2|Y2  =  1)-Pr(Y2=l|Y1  =  0)  =  p^, 
fM,N*|Q  (1>2I°)  =  Si,]/  Pr(Y2=l|Y1=0)+g0jl'Pr(Y2=0|Y1=0) 

=  p0(i-Pl)  +  ^0s0,i, 

fM,N*|Q    (0>2I°>    =  g0s0'    PHYg-OlY^O)    =    r0gQj0, 

fM,N*|Q    C-1,2 | 0)=  g0jl.    Pr(Y2=-l|Y1=0)+g0jl.Pr(Y2=0|Y1=0) 

=  PqCI-P!)    +    rQg0jl, 

fM,N*|Q    (-2, 3 | 0)=  g2j2-    Pr(Y3=-2|Y2=-l)-Pr(Y2=-l|Y1=0)=p0p1. 

Note    that 

.l_2    fM,N*|Q    U.»,|0>    =    2P0    +    -0    j_2    ?0,j    "    1. 

[   0  k  =  1 

since        E    g    .    =    1    and   r      =  < 

J      0J  °       \l-2p0      k>l 

The  probabilities,  f   m*Iq  (j'1^*!1)  for  i^°>  can  be 
determined  in  a  similar  fashion  so  that  from  (10)  and  (11) 
the  procedure  transition  and  iteration  matrices  can  be 
written  : 
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Here,  a. .  is  the  probability  that  the  experiment  ends  at 
level  ,1  given  it  starts  at  level  i  and  b.  .  is  the  probabil- 
ity  that  the  experiment  requires  j  trials  given  it  starts 
at  level  i.   Note  that  A  has  the  reflective  symmetry  prop- 
erty earlier  defined  for  the  P  matrix  and  that  B  is 
symmetric  with  respect  to  its  center  row. 

Next  consider  the  asymptotic  properties  of  A  and  B 
as  k  increases  without  bound.   First  note  that  the  non-zero 
elements  of  each  are  exponential  functions  in  k.   Since 
p.,  q.,  and  g.  .  for  j  /i  are  tail  probabilities  of 
binomially  distributed  variables  and  thus  approach  zero  as 
k  gets  large,  it  is  seen  from  (24)  and  (25)  that 


lim 

A 

k->°° 

lim 

B 

k-*-00 

=  P*  =  A* 


1000 
1000 
1000 
1000 
1000 


=  B* 


(26) 


(27) 


where  P*  is  given  by  (16).   The  positive  elements  in  A*  will 
be  referred  to  as  the  limiting  "diagonal"  of  A.   Intuitively, 
these  results  imply  that  as  the  number  k,  of  observations 
per  trial  is  increased;  the  level  of  the  estimated  mean  j , 
becomes  the  starting  level  i,  for  all  levels  lel7)   except 
i  =  ±u,  and  the  number  of  trials  becomes  the  lower  bound 
n*   of  N*.   Note  that  these  implications  are  consistent  with 
the  interpretation  given  for  P*. 

In  practice  A*  and  B*  are  of  little  interest  since  there 
is  usually  a  physical  or  monetary  constraint  on  the  number 
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of  observations  which  can  be  taken.   A  property  which  may 
be  of  interest  however  is  the  rate  at  which  A  and  B  approach 
their  limiting  forms.   If 

Ax(k)  =  (Ak  a±.    (k)),  (28) 

B1(k)  =  (Ak  b±.    (k)),  (29) 

where  A,  x..(k)  is  the  receeding  difference  of  x..(k)  with 
respect  to  k 


Ak  x.j(k)  =  xlj(k)  -  x.j  (k-1) 


then   it    can  be    shown   that 


ilim     A,    =    0  (30) 


ki~      B1   -   0    .  (3D 


Furthermore,  there  exists  a  k'  such  that  for  k>k"  the  ele- 
ments of  A  on  the  limiting  diagonal  are  increasing  to  one 
while  all  the  other  elements  of  A  are  decreasing  to  zero. 
Likewise,  the  elements  of  the  first  column  of  B  are  strictly 
increasing  to  one  while  all  other  elements  are  at  zero  or 
decreasing  to  zero. 

While  the  results  of  this  section  hold  specifically 
for  procedures  r   inland  the  estimator  defined  by  (18), 
it  is  believed  that  similar  results  can  be  obtained  for 
other  procedures  in  (Z   defined  by  W(6.,  k,  0,  1).   That 
is,  a  change  in  the  stopping  rule  6,  to  permit  more  trials, 


should  not  alter  the  result  that  as  k  Increases  the  level 
of  the  estimated  mean  approaches  the  starting  level  of  the 
experiment  and  that  the  number  of  trials  approaches  the 
lower  bound  permitted  by  the  stopping  rule. 

In  a  later  section,  the  efficiency  of  alternative  pro- 
cedures in  r,  will  be  examined  at  which  time  there  will  be 
occasion  to  refer  to  some  of  the  results  obtained  above. 
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III.   EFFICIENCY  OF  THE  GENERAL  PROCEDURE 

In  this  chapter,  a  methodology  for  evaluating  alter- 
native procedures  in  the  class  €>    will  be  discussed.   A 
loss  plus  cost  objective  function  is  used  with  an  appropr- 
ate  criterion  to  determine  an  optimal  procedure  in  a 
manner  analogous  to  Wald's  decision  problem  [17]  where 
the  space  of  terminal  decisions  is  7?? ,  the  finite  set  of 
equally  spaced  levels.   No  attempt  will  be  made  to  deter- 
mine the  optimal  procedure  in  Q  ,  rather  it  is  assumed 
that  a  finite  number  of  procedures  in  £>   ,  say  r,  are  to  be 
evaluated  and  compared. 

Recall,  an  experiment  ends  at  some  level  M  in  ^  when 
m  ,  determined  by  use  of  Y,  is  at  level  M.   Suppose  there 
exists  some  procedure  W*  in  C  ,  not  necessarily  in  r  the 
set  of  procedures  being  evaluated,  whose  use  will  almost 
surely  cause  the  experiment  to  end  at  level  0,  the  level 
of  the  true  mean.   Then  W*  is  preferred  to  a  procedure 
which  results  in  the  experiment  ending  at  level  j  ,  j  ¥  0 . 

Let  H  =  h(j)(j  =  0,  ±1,  ...,  ±u)  be  an  integer  valued 
function  which  gives  the  loss  incurred  when  the  experiment 
ends  at  level  j.   Note  that  h(M)  is  a  random  variable. 
Since  It  is  preferred  that  the  experiment  end  at  level  0, 
the  loss  h(0)  can  be  taken  as  zero.   The  structure  of  the 
loss  function  may  be  known  or  its  form  assumed.   Indeed, 
the  nature  of  the  random  variable  having  the  distribution 
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G  or  the  intended  use  of  m  ,  the  estimated  mean,  may  suggest 
an  appropriate  structure.   If  the  structure  of  the  loss 
function  is  unknown,  one  of  several  empirically  derived 
loss  functions  might  be  used.   For  instance,  one  which  is 
frequently  cited  in  the  literature  is  quadratic  in  the 
distance  between  the  estimate  m   and  the  true  mean  m   [17]. 
In  this  case, 

h(j)  =  n(j-0)2  =  nj2,  (32) 

where  n  is  an  integer  weighting  factor,  might  be  used. 
Suppose  the  cost  of  experimentation  is  known;  that  is,  there 
is  some  constant  cost,  called  the  "set-up"  cost  which  is 
independent  of  the  number  of  observations  taken,  and  some 
variable  cost,  dependent  upon  the  number  of  observations 
taken,  both  of  which  are  known.   Without  loss  of  generality 
define  h(j),  often  called  the  cost  of  missclassification, 
in  units  of  the  cost  of  observations  and  take  the  "set-up" 
cost  as  zero.   Then  the  total  loss  incurred  L,  is  given  by: 

L  =  H  +  N,  (33) 

where  L  is  also  in  units  of  the  cost  of  an  observation. 
In  the  next  two  sections  the  problem  of  choosing  an 
optimal  procedure  W*  from  a  set  of  alternatives  r  is  con- 
sidered, first  using  criteria  based  upon  the  expected  value 
of  the  total  loss  and  then  using  criteria  based  upon  the 
variance  of  the  total  loss.   Finally,  the  results  of  the 
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chapter  are  extended  to  the  special  case  discussed  in  the 
preceeding  section. 

A.   CRITERIA  USING  THE  EXPECTED  VALUE  OF  THE  LOSS 

Given  a  particular  procedure,  W  in   r,  if  an  experiment 
is  performed  a  large  number  of  times  and  the  loss  evaluated 
by  (33);  then  the  expected  value  and  variance  of  the  average 
total  IosSjoT*  ,  are  given  by: 

E  [^vl=  E  [L] 


Var  [/,]=  i  Var  [L]  , 


v   v 

where  v  is  the  number  of  replications  of  the  experiment 
[13].   These  results  express  the  principle  of  the  law  of 
large  numbers  in  that  as  v  increases  to  infinity  the  vari- 
ance of  the  average  total  loss  goes  to  zero.   Furthermore, 
the  average  total  loss  JC     is  approximated  by  the  expec- 
tation of  the  total  loss,  given  by 

E  [L]  =  E  [H]  +  E  [N] .  (3^) 

An  expression  for  (3*0,  the  expected  total  loss,  which 
depends  upon  the  prior  distribution  of  Q,  and  A  and  B 
matrices  discussed  In  the  previous  chapter,  the  loss 
function  h  and  the  range  of  N  will  now  be  derived. 

Let  F  in  n  be  the  distribution  function  of  the  random 
variable  Q  with  mass  function  f(i)  denoting  the  probability 
that  the  experiment  starts  at  level  i  (I  =  0,  ±1,...,  ±u). 
Here  fi  is  a  set  of  distribution  functions,  the  elements  of 
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which,  in  general,  are  not  completely  specified.   Let  q  in 
Q   be  a  i    x  1  column  vector  whose  i-th  component  is  a  prior 
estimate  of  f(i);  that  is,  q  represents  a  prior  distribution 
on  Q.   Then  the  mass  function  of  the  random  variable  M  is 
given  by 


gM  ( J  )  =  q "  A ; 


(35) 


that  is,  gM(j)  is  the  probability  that  the  experiment  ends 
at  level  j  ( j    =    0 ,  ± 1 ,  . . .  ,  ±  u) .   If  h,  is  an  I    x  1  column 
vector  whose  j-th  component  is  the  loss  h(j)  incurred  when 
the  experiment  ends  at  level  j ,  then 


u 


E  [H]  =   Z    gM  (j)  h  (j)  =  q'  A  h1  . 
j=-u 


(36) 


Similarly,  the  mass  function  of  the  random  variable  N 
is  given  by: 


gN  (n)  =  q'  B, 


(37) 


where  gvr(n)  is  the  probability  that  the  experiment  ends 

after  n  observations  (n  =  nT  ,  .  .  .  ,  n  ).   If  n   is  a 

J-j         U  I 

(nTT  -  nT  +  1)  x  1  column  vector, 


U    "L 


n 


L 


n 


U 


then  the  expected  number  of  observations  is  given  by 

nu     ,  N       -.   - 
E  [N]  =   Z    gN(n)  •  n  =  q   B  nr 

n=nL 


(38) 
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Hence,  using  (36)  and  (38),  the  expected  total  loss 
given  in  (3*0  can  be  written 

E  [L]  =  q'  (Ah^  +  Bn^)  =  q'  r;  (39) 

where 

F  =  Ah,  +  Bn^  =  E  [L/Q]  (40) 

is  a  £  x  1  vector  of  conditional  expected  total  losses. 
Note  that  the  components  of  r  depend  upon  W.   In  fact  (40) 
represents,  using  Wald's  notation  [17]  ,  a  vector  valued 
function 

r  =  r  (W)  (41) 

the  i-th  component  of  which  is  the  expected  total  loss 
(risk)  given  the  experiment  starts  at  level  i;  i  =  0, 
±l,...,±u.   Likewise  the  expected  total  loss  is  equivalent 
to  Wald's  average  risk  function  [17];  that  is, 

E  [L]  =  q*  r  =  r*  (q,  W) .  (42) 

Note  that  in  case  there  is  no  loss  associated  with  an 
experiment  that  ends  at  level  j  (that  is,  h  (j)  =  0,  for 
all  j),  then  (39)  reduces  to  the  expected  number  of  obser- 
vations given  by  (38).   Given  a  prior  distribution  on  Q, 
It  is  clear  that  the  expected  loss  may  be  determined  from 
(39)  for  each  procedure  W  in  F.   The  remainder  of  this 
section  is  devoted  to  a  consideration  of  decision  criteria 
that  might  be  used  in  finding  the  best  procedure  in   r. 
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1 .   Bayes  Procedure 

A  procedure  W*  In  T  which  minimizes  the  expected 
total  loss  over  all  W  in  r  may  be  regarded  as  an  optimal 
procedure  [17].   More  precisely  a  procedure  W*  such  that 

E  [L]  =  r*  (q,W*)  =  Jjjp   r*  (q,W) ,  (43) 

is  called  a  Bayes  procedure  in  T    relative  to  q.   Thus,  if 
prior  information  on  the  distribution  F  exists  and  Is  known 
to  the  experimenter,  he  may  evaluate  alternative  procedures 
in  the  set  T    using  the  Bayes  criterion  as  a  measure  of  the 
optimal  procedure's  efficiency.   Such  conditions  may  arise, 
for  example,  as  a  result  of  pilot  testing.   Indeed,  in  the 
elevation  procedure  of  the  field  artillery  precision  regis- 
tration technique,  discussed  in  IV,  it  is  often  possible  to 
obtain  such  information.   Note  that  in  case  the  distribution 
F  is  such  that  the  experiment  starts  at  some  level  i  with 
probability  one,  that  is,  if 

q  =  e.  (44) 

where  e.  is  a  £  x  1  column  vector  having  one  as  its  i-th 
component  and  zero  elsewhere,  then  (39)  becomes 

E  [L]  =  eVF  =  r±    (i  =  0,  ±1,...,  ±u). 

The  set  of  vectors  defined  by  (44)  is  called  the  set  of 
unit  vectors  in  Euclidean  £-space  and  will  be  denoted 
q  e  E  . 
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2 .   Minimax  Procedure 

A  procedure  W*  in  T    such  that 

E  [L]  =  r*(q*,  W* )  =  JJ^  ™*   r*(q,  W)  (45) 

is  called  a  minimax  procedure  [171.  In  some  circumstances, 
particularly  if  the  prior  distribution  on  Q  is  not  known,  a 
minimax  procedure  may  be  regarded  as  an  optimal  procedure. 
Here  one  first  determines  for  each  W  a  vector  q  (a  distri- 
bution) which  is  most  unfavorable  (that  is,  results  in  the 
largest  expected  loss)  and  then  chooses  W*  to  minimize  the 
effect  of  the  unfavorable  distributions. 

B.   CRITERIA  USING  THE  VARIANCE  OF  THE  LOSS 

Now  suppose  some  procedure  W  in  r  is  known  to  be  optimal 
with  respect  to  one  of  the  criteria  discussed  in  the  previous 
section.   In  some  circumstances,  W  may  be  the  optimal  pro- 
cedure for  performing  the  experiment.   But  in  other  circum- 
stances, it  may  be  useful  to  know  the  variance  of  the  total 
loss , 

Var  [L]  =  Var  [H]  +  Var  [N]  +  2  Cov  [H,  N]  ,     (46) 

where  Cov  [H,  N]  is  the  covariance  of  the  random  variables 
H  and  N,  before  the  "best"  procedure  can  be  selected.   An 
expression  for  the  variance  of  the  total  loss,  similar  to 
the  matrix  equation  given  by  (39)  for  the  expected  total 
loss,  will  now  be  derived. 
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Let  h  be  a  I    x  1  column  vector  whose  j-th  component 

2 
is  [h  (j)]";  that  is,  the  square  of  the  loss  incurred  when 

the  experiment  ends  at  level  j  (j  =  0,  ±1,...,  ±u).   Let 

PL  be  a  (n„   -   nj    +  1)  x  1  column  vector, 


(nL) 


n2  = 


(V 


2 


It  follows  that  the  second  moments  of  H  and  N,  respectively, 
are : 


,2 


u 


2 


E  [H"]  =  1         gM(j)  [h(j)]   =  q'  A  h2, 


j=-u 


n. 


It 

E  [N2]  =  1         gN(n)  n2  =  q'  B  n  , 
n=nL 


(47) 


(48) 


where  use  is  made  of  (35)  and  (37).   Hence  the  variance  of 
H,  using  (47)  and  (36),  can  be  written  in  matrix  notation 


Var  [H]  =  E  [H2]  -  E2  [H] 


**      n   **  " 


=  q   Ah2  -  q   Ah  h1    A  q 


(49) 


Likewise,  the  variance  of  N  can  be  written  as 


Var  [N]  =  E  [N2]  -  E2  [N] 


=  q'  Bn2  -  q'  Bn-.n'  B^q, 


(50) 


upon  substitution  of  (48)  and  (38). 

The  covariance  of  the  random  variables  H  and  N  is  given 
by 
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Cov  [H,  N]  =  E  [HN]  -  E  [H]  •  E  [N]  ,  (51) 

where  the  second  term  on  the  right  hand  side  of  is  known; 
that  is,  using  (36)  and  (38)  the  product  of  the  expected 
values  of  H  and  N  can  be  written  in  matrix  notation, 

E  [H]  '  E  [N]  =  q'  Ah  n£  B '  q .  (52) 

The  product  moment  E  [HN]  can  be  found  from  the  joint  con- 
ditional probability  mass  function  of  the  random  variables 

M  and  N,  given  the  random  variable  Q.   Recall  f„  „i~(1.nll) 

M,N |Q  °  '  '  ' 

gives  the  probability  that  the  experiment  ends  at  level  j 
after  n  observations,  given  it  starts  at  level  i.   It 
follows  that  the  conditional  product  moment  of  H  and  N, 
given  Q  can  be  written: 


nL 


E  [HNIQ  "  1]  "   *    ^  n'  fM  N|Q  (J,n|l)'h(j),  (53) 
j  =  -u  n=nT      »  l^ 


for  i  -  0,  ±1,...,  ±u.   Denote  by  C  =  ( c^. )  a  £  x  l   matrix, 
called  the  Product  Moment  Matrix,  where: 


nU 


Cij     *        U    '    fM,NlO  (J>  nli}   » 


n=nL 


then  the  conditional  product  moment  of  H  and  N,  given  Q  is 
the  scalar  product  of  the  i-th  row  of  C,  denoted  C  ,  and 
the  vector  h ± .      That  is,  equation  53  becomes 

E  [HN|Q  =  i]  =*  Cih1, 

and  it  follows  that 
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u 

E  [HN]  =      Z        ?r    (Q=i)  •  C1h1  =  q"  Ch1.  (54) 

i  =  -u 

Thus,  (51) j  the  covariance  of  H  and  N,  can  be  written 


Cov  [H,  N]  =  q'  Ch1  -  q'Ah.jnJ  B'q  (55) 

The  variance  of  the  total  loss,  equation  46,  can  now 
be  written  in  matrix  notation  using  (49),  (50),  and  (55). 
After  some  rearrangement  of  terms  one  obtains 

Var    [Lj    =    q'    ( Ah ?    +   Bn~2    +    20^) 

-    q'    (Ah-jh.^    A"    +   Bnn^    B'    +    2Ah~1n^    B")q 

=    q"    c    -    q"    Dq,  (56) 

where 

c    =    Ah2    +    Bn2    +    2Ch1 
is    a   &    x    1    vector    and 

D   =    Ah\h"    A'  +   Bn\n'    B'+    2Ah,nr'    B' 

=    (Ahx    +    Bn^)     (Ah^    +   Br^K 

=    r   r'  (57) 

is  a  I    x  I    matrix  and  r  is  the  £  x  1  vector  of  conditional 
expected  total  losses  defined  by  (40). 

Prom  (56)  and  (57),  it  is  seen  that  the  variance  of  the 
total  loss  is  easily  determined  for  a  particular  procedure 
W  in  F  given  a  prior  distribution  on  Q  and  the  r  vector. 
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But  again  one  is  confronted  with  the  problem  of  choosing 
an  appropriate  criterion.   Two  criteria  which  may  be  used 
with  (56)  are  considered  below. 

1 .  Minimum  Variance  Procedure 

A  procedure  W*  in  T   such  that 

Var  [L]  =  v*  (q,  W*)  =  JJ^  v*  (q,  W)  (58) 

will  be  called  a  minimum  variance  procedure  in  r  relative 
to  q.   Here,  perhaps  a  certain  amount  of  liberty  has  been 
taken  in  that  (58)  is  defined  analogous  to  (43)  and  thus  W* 
might  appropriately  be  called  a  Bayes  variance  procedure. 
An  analogy  also  exists  with  minimum  variance  estimators  in 
statistics  which  appears  to  be  more  related  in  the  context 
used  here,  so  that  the  first  mentioned  terminology  will  be 
used.   Hence,  if  a  prior  distribution  exists  and  is  known 
to  the  experimenter,  he  may,  as  when  working  with  the  Bayes 
criterion,  evaluate  alternatives  in  r  using  (58)  as  a 
measure  of  the  optimal  procedure's  efficiency.   Note  that 
if  q  is  a  unit  vector  as  defined  by  (44),  then  (56)  can  be 
written 

Var   [L]  =  e^c  -  e^De± 

=   Ci   -   dii    (1=03   ±1,...  ,   ±U). 

2 .  Mlnimax  Variance  Procedure 

Consider  the  variance  of  the  total  loss  given  by 
equation  56  above.   It  is  known  [10]  that  (56)  is  convex 
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or  concave  depending  upon  whether  the  matrix  of  the  quad- 
ratic form,  -D,  is  positive  semidefinite  or  negative  semi- 
definite.   Hence,  it  must  first  be  established  that  the 
matrix  D  is  positive  semidefinite  before  discussing 
maximization  of  (56)  with  respect  to  q. 

In  (57),  it  is  seen  that  D  =  r  r" .      Since  r  is  a  I    x  1 
vector,  its  rank  is  1  <  I    and  it  follows  that  D  is  a  posi- 
tive semidefinite,  symmetric  matrix,  and  is  singular  [9]. 
Hence,  -D  is  negative  semidefinite  and  the  quadratic  form 
given  by  (56)  is  concave. 

Now  consider  the  quadratic  programming  problem  of  find- 
ing a  q*  which 

maximizes   q '  c  -  q '  Dq 

subject  to  q"  1  =  1 

(59) 
q  >  0 

where  0  is  the  zero  vector  and  1  =  (1,...,  1)".  Since  the 
set  of  feasible  solutions  form  a  convex  set  and  the  objec- 
tive function  is  concave,  it  is  known  from  the  theory  of 
convex  functions  [10]  that  any  relative  maximum  is  also  a 
global  maximum.   (In  this  case  the  global  maximum  is  not 
unique  since  the  quadratic  form  is  not  strictly  concave.) 
Thus  if  a  feasible  solution  to  (59)  exists,  one  may  find 
a  prior  distribution  q*  which  maximizes  the  variance  of 
the  total  loss,  given  by  (56).   Note  that  if  q  is  a  unit 
vector,  then  the  solution  to  (59)  may  involve  integer  pro- 
gramming techniques  since  it  must  be  true  that  q.  =1, 
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q.  =  0  for  all  j  /  i  to  satisfy  the  constraints  of  the 

J 

problem. 

An  additional  criterion  may  now  be  defined.   A  pro- 
cedure W*  in  r  such  that 

Var  [L]  =  v*  (q*,W*)  =  ?*"   ™aX  (q'  c  -  q'  Dq)    (60) 

will  be  called  a  minimax  variance  procedure  provided  a 
feasible  solution  to  (59)  exists. 

For  a  detailed  discussion  of  techniques  which  can  be 
used  in  solving  (59)  the  reader  is  referred  to  Hadley  [10]. 
It  should  be  noted  that  maximization  of  (59)  may  be  facili- 
tated by  the  transformation 

q  =  R'z 

where  R  is  a  I   x  I   non-singular  matrix  such  that 


1   0  .  .  .  0 
0   0  .  .  .  0 

0   0  .  .  .  0 


The  reader  is  referred  to  Anderson  [1]  for  proof  that  R 
exists  and  a  method  for  Its  construction. 

C.   THE  SPECIAL  CASE 

In  the  special  case,  development  of  the  expressions  for 
the  total  loss,  the  expected  total  loss  and  the  variance 
of  the  total  loss  follow  arguments  similar  to  those  given 


5^ 


above  for  the  general  case.   The  arguments  are  not  repeated 
here;  rather  differences  in  the  resulting  expressions  as 
a  consequence  of  (12)  are  noted. 
The  total  loss  is  given  by 


L  =  H  +  kN*. 


(61) 


If  n  *  is  a  (n*  -  n*  +  1)  x  1  column  vector 

-L  U       J-i 


n1 


n*  = 


n 


U 


and  n*  is  a  (n*  -  n*  +  1)  x  1  column  vector 
<-  U      J_i 


n*  = 
2 


(n*L) 


(nV 


2  ! 


2 


then  the  expressions  for  the  expected  value  and  variance  in 
the  number  of  trials  can  be  obtained  by  substituting  n* 
for  n.,  and  n*  for  n?  in  (38)  and  (50),  respectively.   The 
expected  total  loss  is 


E  [L]  =  q'  (Ah1  +  kBn*)  =  q^r 


(62) 


And  the  variance  of  the  total  loss  is 
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Var  [L]  =  Var  [H]  +  k2  Var  [N*]  +  2k  Cov  [H,N*] , 

=  q~'  (Ah2  +  k2Bn*  +  2kCh1) 

-  q'  (Ah-^  A'+k2Bn*n*'  B'+2kAh"1n*'  B')q 

=  q'  c"  -  q'  Dq  (63) 

where  in  this  case  the  covariance  of  H  and  N*  is  obtained 
from  (53)  -  (55)  >  substituting  n*  for  n, , 

c  =  Ah"2  +  k2Bn*  +  2kCh"1J 

D  =  (Ah^  +  kBn*)(Ah1  +  kBn*)". 

Obviously,  one  of  the  criteria  defined  by  (43),  (^5)  or 
(58),  (60)  can  also  be  used  in  the  special  case.   The 
problem,  once  one  of  these  criteria  has  been  selected, 
reduces  to  one  of  evaluating  (62)  or  (63)  for  all  procedures 
under  consideration  and  then  selecting  the  procedure  which 
best  satisfies  the  chosen  criterion. 

In  the  remaining  paragraphs  of  this  section,  the  specific 

example  introduced  in  Chapter  II  will  be  continued.   First, 

It  will  be  shown  that  the  Bayes  procedure  in  the  set  r   can 

be  found  by  analytical  methods.   Then  an  evaluation  of  some 

of  the  procedures  in  r   will  be  discussed. 

1.   Finding  the  Bayes  Procedure  Given  the  Triplet 
Tin,   w,  ?) 

Consider  the  set  of  procedures  r   defined  by 

W(61,  k,  0,  1)  on  7)1   =  {_2}  _is  0,  1,  2}  introduced  in 

B  2.   Recall  the  rule  61  is  to  stop  the  experiment  after 
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both  responses  and  nonresponses  have  been  obtained  at  two 
successive  levels  and  that  N*e  {2,...,  5). 

For  this  set  of  procedures,  the  experimenter  might  like 
to  know  if  there  exists  a  number  k*s  of  observations  per 
trial  which  minimizes  the  expected  total  loss  given  by  (62) 
for  a  given  prior  distribution  and  loss  structure.   For 
example,  he  may  be  faced  with  a  constraint  on  the  number  of 
trials  for  the  experiment  rather  than  on  the  total  number  of 
observations.   Such  a  situation  may  arise,  for  example,  when 
there  is  a  significant  time  lapse  before  response  data  can 
be  observed.   At  any  rate,  a  procedure  with  k*  observations 
per  trial  is  a  Bayes  procedure.   To  see  this,  note  from  (62) 
and  (42)  that 

E  [L]  =  q'  (Ah1+  kBn*)  =  r*  (q,  W) . 

Since  k  is  the  only  unknown  in  W(6-,,  k,  0,  1),  it  follows 
from  (43)  that  the  procedure  W(6-,,  k*,  0,  1)  is  a  Bayes 
procedure.   The  experimenter  may  also  be  interested  in 
knowing  if  there  is  a  relationship  between  the  number  of 
observations  per  trial  and  magnitude  of  the  loss  incurred 
from  making  a  wrong  decision.   For  example,  if  it  is  pos- 
sible that  the  loss  might  be  higher  than  he  anticipates,  he 
may  be  interested  in  knowing  whether  he  should  take  a 
larger  or  smaller  number  of  observations  per  trial. 

For  definiteness ,  suppose  that  the  loss  function  is 
the  quadratic  function  given  in  (32).   Then  the  expected 
total  loss  can  be  written 
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E  [L]  =  q'  (  n Ah1  +  kBn*) 


(64) 


where 


hl  = 


4 

1 
0 

1 
4 


n*  = 


(65) 


and  A  and  B  are  given  by  (24)  and  (25)  respectively  and  n 
is  a  loss  parameter  which  determines  the  magnitude  of  the 
loss.   The  Bayes  procedure  may  be  found  by  minimizing  (64) 
with  respect  to  k  >_  1. 

Since  it  is  assumed  that  q,  the  prior  distribution  of 
Q  is  given,  it  is  sufficient  to  consider  minimization  of 
the  components  of  the  vector  r,  of  conditional  expected  loss, 


r  =  r  (k,  r)  )  =  nAh1  +  kBn* 


(66) 


Note  that  the  components  r  can  be  made  arbitrarily  large  for 
a  given  n  by  choosing  k  large;  that  is 


/   t- 


11m  —  lim 

r  = 
k-+-<»    k-*-°° 


<" 


\       ■— 


+  k 


i 1  \ 

2 

? 

2 

2 

2 


(67) 


where  use  has  been  made  of  (26),  (27)  and  (65).   Next,  con- 
sider minimization  of  r.   Differencing  (66)  with  respect  to 
lelds 
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Akr  (k,  n)  =  nA1(k)  h1  +  kB1(k)  n*  +  B(k-l)  n* 


(68) 


where  A-,(k)  and  B,  (k)  are  defined  by  (28)  and  (29)  res- 
pectively.  It  can  be  shown  that  if  n  =  0,  then 


Akr  (k,  0)  >  0, 


for  all  k  >_  1 ;  and  if  n  >  0,  then  the  existence  of  k*  >  1 
which  minimizes  r  depends  on  the  magnitude  of  n .   Thus,  in 
this  example,  the  conditional  expected  loss  is  minimized 
by  taking  k  =  1  when  n  =  0  or  by  finding  k*  >  1  if  n  is 
sufficiently  large.   For  k  >  k*,  r  is  increasing  in  k.   In 
fact,  here 


lim  A  —  /,    n    lim  0  /,  ,  n  —  n. 
,    A,  r  (k,  n)  =  i    B  (k-1)  n*  = 


where  use  is  made  of  (30),  (31)>  and  the  fact  that 

,  ^  kB-.  (k)  =  0.   Given  that  Q  =  i  and  n  is  sufficiently 

large,  k*  is  that  k  which  satisfies, 


Ak^  (k,  n)  <  0 


ARri  (k  +  1,  n)  >  0. 


Now  consider  the  change  in  (68)  as  n  changes 
Ak    r  (k,  n)  =  Ax(k)  h1. 
It  can  be  shown  that  there  exists  a  k'  such  that  for  k  >  k', 


2    _ 

A,    r  (k,  n )  <  0, 
k,n      '        3 
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a  result  which  implies  that  the  expected  loss  can  be 
decreased  for  high  loss  structures  by  increasing  the  number 
of  observations  per  trial. 

It  follows  from  the  above  that  for  the  set  r,  of  pro- 
cedures defined  by  W(6,,  k,  0,  1)  and  a  quadratic  loss 
function  that  the  existence  of  an  optimal  number  k*,  of 
observations  per  trial  depends  only  on  the  magnitude  of  the 
loss  which  may  be  incurred  from  deciding  that  the  mean  of 
the  distribution  being  sampled  is  at  some  level  other  than 
zero.   That  is,  if  there  is  no  loss  incurred  by  this 
decision,  then  one  observation  per  trial  should  be  taken; 
otherwise  more  than  one  observation  probably  should  be 
taken.   Also,  it  was  shown  that  choosing  W  in  r,  by  finding 
a  number  k*,  of  observations  per  trial  which  minimizes  the 
expected  total  loss  is  equivalent  to  finding  a  procedure 
which  satisfies  (43),  the  Bayes  criterion. 

Comparing  procedures  in  the  set  r,  ,  discussed  above, 
with  Tsutakawa's  procedures  has  been  avoided  because  of 
the  limitation  imposed  by  the  stopping  rule  6, ,  a  rule 
selected  because  of  its  simplicity  and  applicability  to 
the  elevation  procedure  of  the  field  artillery  precision 
registration  discussed  in  Chapter  IV.   Using  the  rule  5.., 
it  is  noted  that  the  up-and-down  method  (that  is,  k  =  1) 
does  not  perform  well  when  compared  to  procedures  in  r, 
with  k  >  1.   It  will  be  seen  in  IV  that  its  performance  is 
considerably  better  under  a  more  liberal  stopping  rule. 
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Indeed,  a  limitation  in  evaluating  procedures  of  the 
special  case  is  the  fact  that  comparisons  are  made  over 
procedures  where  the  total  number  of  observations  (sample 
size)  varies  drastically.   As  mentioned  earlier,  this 
situation  may  be  realistic  if  the  experimenter  is  faced 
with  a  constraint  on  the  number  of  trials  rather  than  the 
total  number  of  observations. 

It  appears  that,  in  the  special  case,  whether  or  not 
there  exists  a  number  k*  >  1  of  observations  per  trial 
which  minimizes  the  expected  total  loss  depends  upon  the 
nature  of  loss  function  and  the  stopping  rule,  6.   While 
the  results  of  this  section  hold  specifically  for  the  stop- 
ping rule  6-.  and  the  estimator  defined  by  (18)  it  is  anti- 
cipated that  similar  results  should  be  obtained  for 
stopping  rules  which  permit  a  larger  number  of  trials  and 
other  estimators . 

2.   An  Evaluation  of  Some  Procedures  in  r^ 

In  order  to  illustrate  the  techniques  of  evaluation 
which  have  been  discussed,  it  was  decided  to  evaluate  the 
loss  characteristics  for  some  procedures  in  T-,  using  data 
generated  by  a  high-speed  didgital  computer.   Recall  that 
r,  is  the  set  of  procedures  considered  in  the  example  intro- 
duced in  section  II  B  2  and  continued  in  the  preceeding 
section.   A  computer  program  (see  page  127)  was  written  in 
FORTRAN  IV  and  ran  on  an  IBM  360  computer  for  k  =  1,...,  6, 
two  loss  functions,  four  values  of  the  loss  parameter,  and 
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the  set  of  prior  distributions  e.  in  E  ,  i  =  0,±1,  ±2, 
Output  from  the  program  is  arranged  as  follows:   for  each 
value  of  the  number  k  of  observations  per  trial,  the  A  and 
B  matrices  are  followed  by  matrices  showing  the  expected 
value  and  variance  of  the  total  loss  given  q  =  e.  in 
E  ,  i  =  0,  ±1,  ±2  (see  page  100).   In  the  remainder  of  this 
section,  the  results  of  the  evaluation  will  be  discussed. 

Tables  I  and  II  show  the  optimal  procedures  in  r,  (that 
is,  optimal  number  k,  of  observations  per  trial)  for  the 
criteria  based  upon  the  expected  value  and  variance  of  the 
total  loss,  respectively,  when  the  loss  function  is  either 
linear  or  quadratic  and  the  loss  parameter,  n,  has  the  value 
indicated.   In  Table  I,  note  that  when  n  =  0,  k  =  1  is 
optimal;  but  when  n  >  0,  k  >  1  is  optimal.   Note  also  that 
using  criteria  based  upon  expected  loss,  the  ordering  among 
alternative  procedures  is  independent  of  the  two  loss  struc- 
tures used  for  the  values  of  n  considered.   On  the  other 
hand,  from  Table  II,  it  is  seen  that  use  of  variance  cri- 
teria is  very  sensitive  to  the  loss  structure.   For  linear 
loss  structures,  variance  criteria  tend  to  indicate  fewer 
observations  per  trial  when  compared  to  expected  loss 
criteria  and  vice  versa  for  quadratic  loss  structures.   In 
general,  the  minimax  criterion  indicates  optimality  for 
procedures  with  a  smaller  number  of  observations  per  trial 
than  the  Bayes  criterion  relative  to  starting  at  level  0. 
other  words,  as  anticipated  the  minimax  procedure  was 
J  to  be  protective  against  a  high  loss  resulting  from 
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starting  away  from  level  0.   On  the  other  hand,  it  seems 
more  difficult  to  explain  the  relation  between  the  minimax 
variance  criterion  and  the  minimum  variance  criterion. 
For  a  linear  loss  structure,  the  minimax  variance  criterion 
indicates  optimality  for  a  procedure  with  one  observation 
per  trial  which,  in  general,  is  also  indicated  by  the 
minimum  variance  criterion  relative  to  starting  at  level  0. 
But  for  a  quadratic  loss  structure,  the  minimax  variance 
criterion,  in  general,  was  found  to  be  protective  against 
high  variances  resulting  from  starting  away  from  level  0. 

Recall  that  the  technique  used  in  the  preceeding  section 
to  show  how  the  Bayes  procedure  could  be  found  analytically 
consisted  of  minimizing  (66)    with  respect  to  k.   Figures  2 
and  3  show  the  expected  value  of  the  loss,  given  the  experi- 
ment begins  at  level  0,  as  a  function  of  k  and  ri  for  quad- 
ratic and  linear  loss  structures.   Note  the  increases  which 
occur  at  k  =  4 .   These  anomalies  are  a  consequence  of  (19); 
that  is,  the  fact  that  level  0  is  by  definition  the  midpoint 

Q 

of  the  open  interval  \-\3    k) .         Note:   the  minima  indicated 
by  the  curves  correspond  to  the  optimal  Bayes  procedures 
relative  to  e   in  EJ   which  are  indicated  in  Table  I;  the 
curves  for  n  =  0  are  strictly  increasing;  the  curves  are 


q 
It  turns  out  that  g0  ]_,  given  by  (23),  is  significantly 
higher  for  k  =  4  than  it  is  for  k  =  5  (approximately  0.12 
as  compared  to  0.06).   Thus  if  k  =  4  and  the  experiment 
starts  at  level  0  there  is  a  higher  probability,  relative  to 
k  =  3  or  5 j  that  the  experiment  will  end  at  some  level  other 
than  level  0.   The  resulting  effect  is  a  higher  expected 
loss  for  k  =  4. 
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Figure  2.   Expected  Value  of  the  Total  Loss  Given 

the  Experiment  Begins  at  Level  0  as  a  Function 
of  the  Number  of  Observations  per  Trial  and 
the  Magnitude  of  the  Loss  Parameter  n  for 
Procedures  W(6,,k,0,l)  and  a  Quadratic  Loss 
'■ucture . 
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Figure  3-   Expected  Value  of  the  Total  Loss  Given 

the  Experiment  Begins  at  Level  0  as  a  Function 
of  the  Number  of  Observations  per  Trial  and 
the  Magnitude  of  the  Loss  Parameter  n  for 
Procedures  W(6,,k,0,l)  and  a  Linear  Loss 
Structure . 
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asymptotic  to  the  line  r   =  2k,  an  asymptote  suggested  by 
(67);  and  the  slopes  of  the  curves,  in  general,  are  decreas- 
ing for  higher  values  of  n* 

The  results  from  the  evaluation  of  some  procedures  in 
r\  are  helpful  in  several  important  ways.   First,  they  tend 
to  validate  the  evaluation  methodology  presented  earlier; 
that  is,  the  results  were  consistent  with  expectations. 
Secondly,  they  give  insight  into  the  selection  of  one  of 
the  criteria  discussed,  and  lastly,  some  consequences  of 
the  model  have  been  brought  out;  for  example,  it  might  be 
that  level  0  should  be  defined  as  the  midpoint  of  a  closed 
interval . 
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IV.   APPLICATION  TO  THE  ELEVATION  PROCEDURE  OF 
THE  FIELD  ARTILLERY  PRECISION  REGISTRATION 

Field  artillery  weapons  are  normally  positioned  so  that 
muzzle  blasts  from  the  weapons  cannot  be  seen  by  ground 
observers  of  an  opposing  force.   As  a  consequence,  projec- 
tiles fired  from  the  weapons  must  be  fired  at  targets  which 
usually  are  not  visible  from  the  weapon  position.   Fire 
delivered  under  these  circumstances,  normally  from  weapons 
having  a  relatively  low  muzzle  velocity,  is  called  indirect 
fire.   Given  the  location  of  the  weapon,  the  location  of 
the  target,  and  ballistic  data  based  upon  standard  weapon- 
weather-ammunition  conditions,  one  can  compute  firing 
data — direction  (called  deflection),  elevation  angle,  and 
ammunition  fuze  setting — which  under  standard  conditions 
will  cause  the  mean  point  of  impact  of  the  projectiles  to 
be  on  the  target.   In  practice,  standard  conditons  rarely 
exist  and  there  are  usually  some  location  and  delivery 
errors.   Thus,  if  a  number  of  projectiles,  later  referred 
to  as  rounds,  is  fired  at  a  target  using  standard  data  and 
the  mean  point  of  impact  is  determined,  there  is  some 
cummulative  error  due  to  nonstandard  conditions  which  causes 
the  mean  point  of  impact  to  be  away  from  the  target.   The 
precision  registration  technique  is  one  method  which  Is 
used  by  U.S.  Army  and  Marine  Corps  field  artillery  units 
to  determine  the  magnitude  of  a  correction  for  this  error. 
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A  precision  registration  is  performed  to  determine,  by 
adjustment,  the  firing  data  which  will  cause  the  mean  point 
of  impact  of  a  group  of  rounds  to  be  at  a  point  of  known 
location,  called  the  registration  point  [7].   Note  that 
this  is  at  least  a  two  dimensional  problem.   An  adjusted 
deflection  and  elevation  must  be  determined  and  if  an 
adjusted  fuze  setting  is  desired  so  that  air  bursts  are 
achieved,  then  it  becomes  three  dimensional.   Since  the 
discussion  ultimately  concerns  only  the  adjusted  elevation 
it  is  assumed  in  that  which  follows  that  an  adjusted  fuze 
setting  is  not  desired.   In  a  precision  registration,  firing 
is  conducted  in  two  phases  using  only  one  weapon.   In  the 
first  phase,  called  the  adjustment  phase,  the  objective  is 
to  adjust  the  mean  center  of  impact  of  a  group  of  rounds  to 
within  a  specified  distance  of  the  registration  point. 
This  is  accomplished  by  use  of  an  observer  who  determines 
corrections  and  transmits  them  to  fire  direction  personnel. 
Normally  the  observer  uses  a  bracketing  procedure.   In  the 
second  phase,  called  the  fire-for-ef feet  phase,  a  number  of 
rounds  is  fired  to  permit  refinement  of  the  mean  center  of 
impact.   Here  the  observer  transmits  quantal  response  data 
only;  that  is,  he  observes  where  the  round  bursts  in  rela- 
tion to  the  registration  point  and  transmits  this  informa- 
tion to  fire  direction  personnel.   The  number  of  rounds  used 
Ln  the  fire-for-ef feet  phase  varies  randomly  and  the  phase 
ends  when  a  set  of  decision  criteria  are  satisfied. 
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Note  the  similarity  between  the  fire-for-ef feet  phase 
of  the  precision  registration  and  the  bio-assay  experiment. 
The  first  round  fired  in  the  fire-for-ef feet  phase  is  the 
first  trial  of  an  "experiment"  being  performed  to  estimate 
the  adjusted  firing  data.   One  cannot  measure  the  set  of 
"critical"  firing  data  which  causes  the  mean  point  of 
impact  to  be  at  the  registration  point.   He  can  only  select 
a  set  of  data  and  then  observe  where  the  round  bursts  in 
relation  to  the  registration  point.   In  addition,  it  is 
well  known  that  if  a  large  number  of  bursts  is  observed, 
then  the  distribution  of  the  bursts  about  the  registration 
point  is  approximately  normal.   Also,  the  variance  is  known 
from  previous  test  firings.   Hence,  the  fire-for-ef feet 
phase  of  the  registration  may  be  viewed  as  an  experiment 
to  estimate  the  mean  of  a  bivariate  normal  distribution 
having  known  covariance  matrix. 

Separate  procedures,  implemented  simultaneously,  are 
currently  used  to  determine  the  adjusted  deflection  and  the 
adjusted  elevation  in  the  fire-for-ef feet  phase.   One  is 
not  dependent  on  the  other  in  that  the  adjusted  deflection 
may  be  determined  first,  or  vice  versa.   It  thus  seems 
reasonable  to  assume  that  the  fire-for-ef feet  phase  consists 
of  two  independent  procedures.   In  that  which  follows  this 
assumption  has  been  made;  that  is,  the  elevation  procedure 


Thus,  when  "the  experiment"  is  referred  to  it  is  clear 
that  what  is  meant  is  "the  fire-for-ef feet  phase  of  the 
registration. " 
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is  viewed  as  an  experimental  procedure  for  estimating  the 
mean  of  a  univariate  normal  distribution.   It  is  also 
assumed  that  firing  is  to  be  conducted  at  elevation  angles 
less  than  45  degrees,  that  there  is  independence  between 
bursts,  and  that  the  registration  point  is,  in  fact,  a 
point  on  the  real  line  so  that  the  probability  of  hitting 
the  registration  point  is  zero.   The  purpose  of  this  chap- 
ter is  to  show  that  the  elevation  procedure  currently  in 
use  belongs,  under  the  assumptions  made  above,  to  the  class 
of  sequential  procedures  £T  ,  defined  in  I .   A  second  purpose 
is  to  compare  the  efficiency  of  the  current  procedure  with 
some  alternative  procedures  in  &   . 

A.   THE  CURRENT  ELEVATION  PROCEDURE 

The  current  elevation  procedure,  later  referred  to  as 
the  "current  procedure,"  will  now  be  described  within  the 
framework  of  an  experiment.   The  fire-f or-ef feet  phase  is 
entered  when  it  is  determined  that  a  correction  given  by 
the  observer  will  move  the  burst  within  a  specified  distance 
of  the  registration  point.   The  elevation  determined  from 
this,  the  observer's  last  correction,  establishes  the 
Initial  level  of  the  experiment  and  the  first  trial  is  per- 
formed by  firing  one  round  at  the  registration  point  using 
the  elevation  corresponding  to  this  initial  level.   If  the 

round  bursts  at  a  range  greater  (less)  than  the  range 
to  the  registration  point,  it  is  said  to  be  over  (short) 
and  the  next  level  for  the  experiment  is  determined  by 
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decreasing  (increasing)  the  elevation  by  an  amount  which 
will  move  the  mean  center  of  impact  four  range  probable 
errors.     Succeeding  trials  of  the  experiment  are  per- 
formed by  firing  one  round  at  succeeding  levels  until  a 
burst  is  observed  to  be  short  (over) .   This  establishes  a 
one  fork  elevation  bracket;  that  is,  an  over  and  a  short, 
fired  at  levels  one  fork  apart,  have  been  observed.   The 
next  level  of  the  experiment  is  the  midpoint  of  the  one 
fork  elevation  bracket,  and  the  next  trial  is  performed 
by  firing  three  rounds  at  this  level.   If  the  majority  of 
the  bursts  are  over  (short),  then  the  last  level  of  the 
experiment  is  the  elevation  corresponding  to  the  short 
(over)  end  of  the  one  fork  elevation  bracket  and  the  last 
trial  of  the  experiment  is  performed  by  firing  two  rounds 
at  this  level. 

In  the  experimental  procedure  just  described  note 
that:   the  number  N,  of  rounds  fired  is  a  random  variable 
since  more  than  two  trials  may  be  necessary  to  establish 
a  one  fork  elevation  bracket;  the  number  k,  of  rounds  fired 
per  trial  is  not  constant;  and  successive  trials  of  the 
experiment  are  not  performed  at  successive  levels.   Hence, 
the  current  elevation  procedure  of  the  field  artillery 
precision  registration  technique  is  a  member  of  the  class 
of  procedures  €>    defined  in  I  and  can  be  modeled  by  the 
general  procedure  W(6,  k,  ,  k,°,  C,  )  in  Q  . 


One  range  probable  error,  PEr,  is  approximately  0.67 
standard  deviations.   Pour  PRr  is  called  a  fork. 
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Let  nr   =  {...,  -1,  0,  1,...}  be  a  set  of  equally 
spaced  levels  having  interval  m  =  1/2  fork  where  the  level 
0  corresponds  to  the  registration  point.   Let 
7//  =    {-3,...,  0,...3>  be  a  subset  of  TT)  \      Then  the  current 
elevation  procedure  can  be  described  as  follows.   The  exper- 
iment (the  fire-for-effect  phase)  begins  at  some  (elevation) 
level  Y-,  in  7T]    with  one  observation  on  the  first  trial. 
Here,  Y,  is  in  7/1   because  the  adjustment  phase  does  not  end 
until  the  mean  center  of  impact  is  adjusted  to  within  a 
specified  distance  of  the  registration  point.   An  observa- 
tion is  a  response  (an  over)  or  a  nonresponse  (a  short) 
depending  upon  whether  the  round  bursts  at  a  range  greater 
than  or  less  than  the  range  to  the  registration  point. 
If  G  is  the  distribution  of  bursts  about  the  registration 
point  when  the  mean  point  of  impact  is  at  the  registration 
point,  then  the  probability  of  a  response  at  level  j  is 
G(j);  J  =  -3,..., 3.   This  is  just  the  probability  that  the 
adjusted  elevation  is  less  than  the  elevation  used  to 
perform  a  trial  of  the  experiment  at  level  j .   The  experi- 
ment continues  at  levels  Yp,...,Y  *,  with  k?,...,k  * 
observations  per  trial,  determined  by: 


t  + 


if  kt°  <  Jt  <  kt  -  kt°,  t  >  1 

Yt  -  Vm      lf  kt  -  kt°  i  Jt  <kt 


where  J   is  the  number  of  responses  on  the  t-th  trial  and 
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ct  ■ 


2    1  £  t  £  n*  -  3 

1    n*-2<t<n*-l 


1  <  t  <  n*  -  2 
t  =  n*  -  1 

1  <  t  <  n*  -  2 


kt   =  <  3    t  =  n*  -  1 


2    t  =  n* 

are  sequences  of  integers.   The  rule  6  in  W(6,  k, ,  k,  ,  C, ) 
is  to  stop  the  experiment  two  trials  after  the  first  rever- 
sal in  the  sequence  of  responses  {J,}  is  obtained.   For 
example,  if  J,  =  0,  J?  =  0  and  J-  =  1,  then  two  more  trials 
would  be  performed  and  n*  =  5.   Note  that  since  7?1   =  {-3, 
.t.,0,...,3}  as  few  as  seven  rounds  and  as  many  as  nine 
rounds  may  be  required  for  the  experiment  since  if  it 
starts  at  level  -3,  as  many  as  four  rounds  may  be  required 
to  establish  a  one  fork  elevation  bracket. 

When  firing  has  been  completed,  the  adjusted  elevation 
is  computed  using  the  data  from  the  last  two  trials  and  an 
earlier  trial  performed  at  the  same  level  as  the  last  trial 
Thus  six  observations  are  used  from  trials  performed  at 
two  of  the  levels  in  W.   The  adjusted  elevation  is  the 
mean  elevation  fired  to  obtain  this  group  of  six  observa- 
tions Y,  plus  an  elevation  change  AY,  determined  by: 


AY  =  - 


difference  in  number  of  overs  and  shorts 
2x6  (the  number  of  observations) 


x  fork, 
(69) 
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where  the  sign  of  the  right  side  is  negative  because  a 
positive  difference  in  the  number  of  overs  and  shorts 
indicates   the  mean  elevation  fired  is  greater  than  the 
adjusted  elevation.   Let  A  be  the  difference  in  overs  and 
shorts,  then  (69)  can  be  written 

AY  =  -  ^ 
6 

where  use  has  been  made  of  the  fact  that  m  =  i  fork.   Let 
J   be  the  total  number  of  responses  (overs),  then 

A  =  JT  -  (6  -  JT)  =  2  JT  -  6 

so  that  the  adjusted  elevation  may  be  computed  using  the 
estimator 


n 


* 


Y  =  il      Y  -   I  J   +  m  (70) 

d    t=n*-l   t    5      l 

Note  that  if  the  total  number  of  responses  is  three  (that 
is,  if  there  are  three  overs  and  three  shorts),  then  the 
last  two  terms  of  (70)  sum  to  zero. 

Given  the  triplet  (77) ,  W,  Y)  the  procedure  transition 
and  iteration  matrices  can  now  be  determined  from  (10)  and 
(11).   Let  Q  be  a  discrete  random  variable  with  distribution 
function  F  which  denotes  the  level  Y,  in  7?/  at  which  the 
experiment  begins.   Q  is  a  random  variable  because  Y,  is 
determined  by  a  process  of  adjustment  which  is  subject  to 
random  error.   Indeed,  if  the  interval  m  between  levels  in 
77)  is  large,  then  the  distribution  may  concentrate  nearly 
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all  its  mass  at  level  0.   Let  M  be  a  discrete  random 
variable  which  denotes  the  level  in  7??  which  represents 
the  adjusted  elevation.   Recall  from  II,  that  #?  represents 
a  finite  set  of  midpoints  of  disjoint  intervals,  the  union 
of  which  forms  an  open  interval  on  the  real  line.   Thus 
the  adjusted  elevation  can  be  represented  by  one  of  the 
levels  in  W  and  the  joint  conditional  probability 
fMjN|Q(J,  n|i),  (i,j  =  -3,. ..0,...,3;  n  =  7,8,9)  that  the 
experiment  ends  at  some  level  j  in  771    after  n  rounds  have 
been  fired  given  it  begins  at  level  i,  can  be  found  using 
(7),  (8)  and  a  logic  tree  similar  to  that  shown  in  Figure  1. 
Let  q,  a  (7  x  1)  column  vector  of  probabilities  that  the 
experiment  starts  at  level  i,  be  a  prior  distribution  on  Q. 
The  i,j-th  element  of  the  Procedure  Transition  Matrix  A 
(the  probability  that  the  registration  ends  at  level  j 
given  the  fire-for-ef feet  phase  begins  at  level  i)  is 

9 
aU  =  nl7    fM,N|Q  ^>    nli}  (71) 

and  the  probability  that  the  registration  ends  at  level  j , 
given  by  (35) ,  is 

Pr  [M  =  j]  =  gM(j)  =  q'  A  . 

Likewise,  the  i,j-th  element  of  the  Procedure  Iteration 
Matrix  B  (the  probability  that  the  registration  ends  after 
j  rounds  have  been  fired,  given  the  fire-for-ef feet  phase 
begins  at  level  i)  is 
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b    =  I        f    !   (m.  0|i)  (72) 

d        m=  -  3 


and  the  probability  that  the  registration  requires  j  rounds, 
given  by  (37)  is 

Pr  [N  =  j]  =  gN(j)  =  q'  B. 

The  current  procedure  can  now  be  evaluated  using  a  loss 
plus  cost  objective  function  in  a  manner  analogous  to 
Wald's  approach.   If  H  is  a  random  variable  which  denotes 
the  loss  associated  with  a  registration  that  ends  at  some 
level  in  7)1   other  than  level  0  and  the  loss  is  measured  in 
units  of  the  cost  of  a  round,  then  the  total  loss  L,  also 
measured  in  units  of  the  cost  of  a  round,  is  given  by  (33). 
That  is, 

L  =  H  +  N. 

Here,  other  costs  incidental  to  the  experiment  are  assumed 
to  be  constant  and  thus  may  be  neglected  for  purposes  of 
this  evaluation.   It  appears  that  (33)  is  a  reasonable 
objective  function  for  the  elevation  procedure  of  the 
precision  registration.   An  adjusted  elevation  which  makes 
the  total  loss  as  low  as  possible  would  be  preferred.   Con- 
sider, for  example,  the  consequences  of  deciding  that  the 
adjusted  elevation  is  at  level  -3.   This  means  that  subse- 

firing  using  the  adjusted  elevation  as  a  basis  for 
corrections  will,  on  the  average,  be  short  by  six  range 
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probable  errors,  a  situation  that  may  be  intolerable  if 
fires  are  to  be  delivered  close  to  friendly  forces.   Indeed, 
it  is  reasonable  that,  in  certain  circumstances,  a  high 
loss  be  associated  with  making  such  a  decision.   Although 
the  nature  of  the  loss  function  h(j)  may  not  be  known,  one 
of  several  intuitively  plausible  loss  functions  may  be 
used  for  the  evaluation.   This  point  will  be  considered 
below  in  more  detail. 

If  h,  is  a  (7  x  1)  column  vector  whose  j-th  component 
is  the  loss  associated  with  a  registration  which  ends  at 
level  j  and  n-.  is  a  ( 3  x  1)  column  vector,  n-.  =  (7,  8,  9)'» 
then  the  expected  total  loss,  given  by  (39)  >  is 

E[L]  =  q'(A  h1  +  B  n,) 

where  use  is  made  of  (35)  and  (37).   Likewise  if  h~  is  a 
(7  x  1)  column  vector  whose  j-th  component  is  the  square  of 
the  loss  associated  with  a  registration  which  ends  at  level  ,1 
and  n2  is  a  (3  x  1)  column  vector  n?  =  (49,  64,  81)"*,  then 
the  variance  of  the  total  loss,  given  by  (56),  is 

V[L]  =  q'  c"  -  q'D  q 

where  c  =  A  h„  +  B  L  +  2C  L  is  a  (7  x  1)  column  vector, 
D  =  (A  h^   +  B  n\)(A  h   +  B  n,)'  is  a  (7  x  7)  positive  semi- 
definite  symmetric  matrix  having  rank  one,  and  C  h,  is  a 
(7x1)  column  vector  whose  i-th  component  is  the  product 
moment  of  the  random  variables  H  and  N  given  the  experiment 


79 


starts  at  level  1.   The  reader  is  referred  to  III  for  a 
more  detailed  derivation  of  the  variance  of  the  total  loss. 

Given  7/7,  the  statistical  properties  of  the  current 
procedure  can  be  determined  using  (71)  and  (72).   For 
example,  the  probability  that  the  procedure  uses  j  rounds, 
given  fire-for-ef feet  starts  at  level  i  is  given  by  (72). 
The  efficiency  of  the  procedure  can  be  determined  for  any 
finite  loss  structure  from  (39)  and  (56).   Further  discus- 
sion of  the  current  procedure  will  be  deferred  to  a  later 
paragraph  where  its  properties  and  efficiency  can  be  com- 
pared with  those  of  two  alternative  procedures  which  are 
discussed  in  the  next  section. 

B.   ALTERNATIVE  ELEVATION  PROCEDURES 

An  elevation  procedure  which  was  used  in  the  precision 
registration  technique  prior  to  1965  will  now  be  discussed. 
For  convenience,  this  procedure  will  be  referred  to  as  the 
"old  procedure."   Essentially,  the  old  procedure  differs 
from  the  current  procedure  in  that  a  one  fork  elevation 
bracket  is  not  obtained  prior  to  firing  the  initial  group 
of  three  rounds  and  all  subsequent  firing  is  in  groups  of 
three  rounds.   That  is,  the  first  trial  of  an  experiment 
performed  with  the  old  procedure  begins  at  some  level  Y,  in 
S/l   with  three  observations.   The  experiment  continues  at 
levels  Y2,...,Yna,  with  three  observations  per  trial,  deter- 
mined by: 
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t+1 


Yt  +  m 
Y, 


Y   -  m 


If  J   =  0 


if  J 


t 


1,2, 


t  >  1 


if  Jt  =  3 


where  m  =  1/2  fork  and  J,  is  the  number  of  responses  (overs) 
on  the  t-th  trial.   The  experiment  ends  when  both  responses 
and  nonresponses  have  been  obtained  on  two  successive 
trials.   Note  that  the  old  procedure  can  be  denoted 
W(6,,  3j  0,  1),  a  procedure  in  r  .   Note  also  that 
6  <_  n  <_  21  since  the  experiment  could  conceivably  start  at 
level  -3  and  not  obtain  a  response  until  level  3  is  reached. 
When  firing  is  completed  the  estimator  given  by  (70),  where 


n 


* 


J  rp  -    L  J .    , 

t=n*-l  z 


is  used  to  compute  the  adjusted  elevation. 

A  second  alternative  to  the  current  procedure  is  the 
modified  up-and-down  method  with  a  "nominal"  sample  size 
of  six  described  by  Dixon  [4].   This  procedure  will  be 
referred  to  as  the  "bio-assay  procedure."   Under  this  pro- 
cedure, the  experiment  begins  at  some  level  Y-.  in  7?)    with 
one  observation  on  the  first  trial.   The  experiment  con- 
tinues at  levels  Yp,...,Y  ^,  with  one  observation  per  trial, 
determined  by: 


t  +  1 


Yt  +  m 
Yt  -  m 


if  Jt  =  0 
if  J   =  1 


t  >  1 
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where  m  =  1/2  fork  and  J,  is  the  number  of  responses  (overs) 
on  the  t-th  trial.   From  II  this  procedure  can  be  denoted 
W(6„,  1,  0,  1)  where  the  rule  6?  is  to  perform  four  more 
trials  after  the  first  reversal  in  the  sequence  of  responses 
{J,}.   Here  6  <_  n  <_  11  because  the  first  reversal  could 
occur  as  soon  as  the  second  trial  and  as  late  as  the  seventh 
trial  (that  is,  start  at  level  -3)  and  not  obtain  a  response 
until  level  3  or  vice  versa) .   Note  that  the  rule  6~  is 
more  liberal  than  6,  in  that  its  use  permits  four  more 
trials  (instead  of  no  more)  after  the  first  reversal. 
When  firing  is  completed,  the  adjusted  elevation  is  deter- 
mined from  the  estimator 

Y  =  Yn*  +  Km  (73) 

where  Y  #  is  the  last  elevation  fired,  k  is  a  constant 
(see  Table  I  of  reference  4)  which  depends  upon  the  sequence 
{Jt>  and  m  is  the  interval  between  levels.   Equation  73  was 
empirically  constructed  by  Dixon  and  is  essentially  equiva- 
lent to 

,  n*+l 

for  a  nominal  sample  size  of  six.   Here,  Y  -in  is  the  level 

n*  +  l 

that  would  be  used  if  one  more  trial  was  conducted.   For 
example  if  m  =  1,  {Yt>  =  {0,1,2,1,2,1,0},  and  {J  }  = 


{0,0,1,0,1,1,1},  then  *n9+\   =  -1  and  Y  =  |  while  use  of  (73) 


gives  Y  =  0.732. 
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C.   AN  EVALUATION  OP  THE  CURRENT  ELEVATION  PROCEDURE  AND 
SOME  ALTERNATIVES 

A  comparison  of  the  three  alternative  elevation  pro- 
cedures described  above  is  presented  in  this  section.   For 
convenience  the  alternatives  will  be  referred  to  as 
follows : 

A  -  The  old  procedure 

B  -  The  bio-assay  procedure 

C  -  The  current  procedure 
The  objective  function  defined  by  (33)  was  used  with  two 
loss  functions  given  by 

h1(j)  =  nj2     j  =  -3,...,0,...,3  (74) 

f   2 

!  nj     j  =  -3,  -2,  -l 
h2(j)  =  <  (75) 

0     otherwise 

where  r\    is  an  arbitrary  constant  which  determines  the  magni- 
tude of  the  loss.   Note  that  h1  is  both  quadratic  and  sym- 
metric in  j,  while  hp  is  asymmetric.   The  loss  function  h„, 
which  appears  to  be  a  reasonable  when  fires  are  to  be 
delivered  just  beyond  friendly  forces,  associates  a  high 
loss  with  the  decision  that  the  adjusted  elevation  is  less 
than  the  true  adjusted  elevation  and  no  loss  with  the  con- 
verse decision.   The  criteria  used  in  the  comparisons  are 
given  by  (43),  (45),  (58),  and  (60). 

A  computer  program,  similar  to  that  shown  on  page  127, 
was  written  in  FORTRAN  IV  and  ran  on  an  IBM  360  computer  to 


83 


evaluate  equations  39  and  56  for  the  loss  functions  h. 


and 


hp  and  various  values  of  the  loss  parameter.   The  set  of 

—      7 
all  unit  vectors  in  Euclidean  seven  space,  e.  in  E  ,  was 

taken  as  a  set  of  prior  distributions  on  Q. 

A  summary  of  the  statistical  properties  of  the 
various  procedures  given  that  the  fire-for-ef feet  phase  of 
the  registration  begins  at  level  0  is  given  in  Table  III. 
The  data  in  the  table  are  the  center  rows  of  A  and  B 
matrices  which  are  shown  on  pages  118,  121,  and  124,  respec- 
tively for  procedures  A,  B,  and  C.   The  table  is  included 
to  permit  an  appreciation  of  the  relative  merit  of  the 
various  procedures  given  the  fire-for-ef feet  phase  starts 
at  level  0.   Data  for  other  starting  levels  is  contained 
in  the  other  rows  of  the  A  and  B  matrices.   The  data  con- 
tained in  the  table  should  not  be  used  as  a  basis  of 
deciding  that  a  particular  procedure  is  best;  rather,  one 
of  the  criteria  discussed  III  A  1,  III  A  2,  III  B  1,  or 
III  B  2  might  be  used. 

Computations  of  the  expected  loss  and  variance  of  the 
loss  are  shown  for  both  loss  functions  and  seven  values  of 
the  loss  parameter  beginning  on  pages  119,  122,  and  125  for 
procedures  A,  B,  and  C,  respectively.   The  first  column  in 
each  matrix,  the  expected  loss  and  variance  of  the  loss 
when  the  loss  parameter  n  is  zero,  is  equivalent  to  the 
expected  value  and  variance  of  the  number  N,  of  rounds 
fired  during  the  fire-for-ef feet  phase.   To  see  this,  the 
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reader  is  referred  to  the  discussion  of  the  expected  value 
and  variance  of  the  loss  in  III.   Figure  4  shows  plots  of 
the  expected  value  and  variance  of  the  total  number  of 

rounds  as  a  function  of  the  starting  level.   There,  the 

—     7 
indicated  Bayes  procedure  relative  to  e.  e  E   are: 

Procedure  A  for  i  =  0,  ±1,  Procedure  B  for  i  =  ±2,  and 

Procedure  C  for  i  =  ±3.   And  the  minimax  procedure  is  C. 

Thus,  if  there  is  no  loss  associated  with  deciding  that 

the  adjusted  elevation  is  at  level  M,  it  is  seen  that  use 

of  the  current  procedure  gives  protection  against  high 

losses  resulting  from  staring  away  from  level  0.   This 

result  is  characteristic  of  a  minimax  procedure.   Notice 

that  variance  criteria  provide  different  candidates  for 

the  optimal  procedure.   Procedure  A  is  the  minimum  variance 

—     7 
procedure  relative  to  e~    e  E'  while  Procedure  C  is  both 

_     7 
the  minimum  variance  procedure  relative  to  e,  e  E   for 

i/0  and  the  minimax  procedure.   These  results  are  inter- 
preted to  mean  that,  in  the  long  run,  the  use  of  Procedure 
A  or  B  may  result  in  a  smaller  expenditure  of  ammunition; 
but,  the  use  of  Procedure  C  will  result  in  a  near  constant 
expenditure  of  ammunition  per  registration.   It  is  inter- 
esting to  note  the  differences  between  Procedures  A  and  C. 
Note  from  Figure  4  that  use  of  Procedure  A  results  in  a 
smaller  expected  number  of  rounds  if  the  fire-for-ef feet 
phase  starts  at  level  i,  i  =  0,  ±1.   In  practice,  however, 
the  starting  level  cannot  be  fixed  with  certainty.   In  fact, 
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Q,  The  Level  at  Which  the  Pire-for-Ef feet  Phase 
Starts  (Spacing  Between  Levels  is  2PE  ) 


Figure  4.   Expected  Value  and  Variance  of  the  Number 

of  Rounds  Fired  in  Fire-f or-Ef feet  for  Procedures 
A,  B  and  C  as  a  Function  of  Starting  Level  (Here 
the  Loss  Parameter  n  is  Zero). 


the  basis  for  adoption  of  the  current  procedure  (C),  was 
that  an  occasional  observer  error  in  the  adjustment  phase 
would,  when  using  the  old  procedure  (A),  result  in  an 
excessive  number  of  rounds  [16].   While  the  results  shown 
in  Figure  4  substantiate  this  decision,  the  reader  is 
reminded  that  here  the  loss  parameter  is  zero;  that  is,  to 
choose  a  procedure  on  the  basis  of  expected  value  and  vari- 
ance in  the  number  of  rounds  may  be  equivalent  to  deciding 
that  there  is  no  risk  associated  with  deciding  that  the 
adjusted  elevation  takes  on  some  value  other  than  the  true 
adjusted  elevation. 

Suppose  the  loss  structure  can  be  represented  by  h-,  , 
the  quadratic  loss  function  given  by  (7*0.   Figure  5  shows 
the  expected  value  and  variance  of  the  total  loss  as  a 
function  of  starting  level  for  a  quadratic  loss  structure 
when  the  loss  parameter  is  50.   Note  that  Procedures  A 
and/or  B  satisfy  all  of  the  criteria.   Procedure  A  is  both 

the  Bayes  and  minimum  variance  procedure  relative  to 

—     7 

ei  e  E   for  i  =  0,  ±1.   Procedure  B  is  the  Bayes  and  minimum 

_      7 
variance  procedure  relative  to  e.  e  E'  for  i  =  ±2,  ±3.   In 

addition,  Procedure  B  is  both  the  minimax  and  minimax 

variance  procedure,  replacing  Procedure  C  which  satisfied 

these  criteria  under  the  no  loss  assumption.   In  fact,  it 

appears  that  Procedure  B  gets  "better"  as  the  distance 

between  the  starting  level  and  the  registration  point 

increases.   This  result  is  surprising  and  may  be  due  to  the 
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Figure  5.   Expected  Value  and  Variance  of  the  Total 
Loss  for  Procedures  A,  B  and  C  as  a  Function  of 
the  Starting  Level  When  the  Loss  Structure  is 
Quadratic  and  the  Loss  Parameter  n  is  50. 
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use  of  (73)  in  computing  the  adjusted  elevation.   Note  also 
the  magnitude  of  the  variance  of  the  total  loss.   Table  IV 
shows  optimal  procedures  under  the  various  criteria  for 
the  values  of  the  loss  parameter  n  considered  when  the  loss 
structure  is  quadratic.   It  can  be  seen  that  for  n  >  10, 
the  ordering  among  the  alternative  procedures  is  independent 
of  the  magnitude  of  the  loss  parameter  n.   Recall  this  was 
not  true  in  III  C  2  where  evaluation  of  some  procedures  in 
r, ,  including  Procedure  A,  was  discussed.   Here,  this  result 
essentially  means  that  one  need  not  be  concerned  with 
determining  how  large  a  loss  may  be  suffered;  rather  he 
should  deal  with  the  more  important  issue  of  determining 
whether  or  not  a  loss  will  in  fact  be  sustained  and  if  so, 
whether  or  not  a  quadratic  loss  structure  is  appropriate. 
It  should  be  noted  that  the  result  may  not  hold  for  higher 
values  of  the  loss  parameter.   Another  interpretation  of 
the  data  in  Table  IV  is  that  Procedure  B  is  more  conserva- 
tive than  Procedure  A.   This  can  be  seen  by  noting  first 
that  Procedure  B  is,  for  n  >  0 ,  both  a  minimax  and  minimax 
variance  procedure,  and  that  Procedure  B  is  both  a  Bayes 

and  minimum  variance  procedure  relative  to  e.  e  E'  for 

i 

i  =  ±2,  ±3.   In  other  words,  use  of  Procedure  B  gives  pro- 
tection against  high  losses  and  variances  resulting  from 
starting  the  fire-for-ef feet  phase  away  from  level  0.   Note 
however  that  in  case  it  can  be  assured  that  the  fire-for- 
fect  phase  starts  at  levels  0  or  ±1  (that  is,  within  3  PE 
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of  the  registration  point  since  level  1  is  the  midpoint  of 
an  interval  of  length  2  PE  )  then  Procedure  A  is  best  for 
n  >  10. 

Perhaps  a  more  realistic  loss  structure  in  some  cases 
is  one  which  is  asymmetric.   If  it  can  be  represented  by 
h  ,  given  by  (75),  then  the  decision  maker  is  confronted 
with  a  different  situation.   Recall  the  interpretation  of 
hp  is  that  there  is  a  high  loss  associated  with  deciding 
the  adjusted  elevation  is  less  than  the  true  adjusted  ele- 
vation and  no  loss  is  associated  with  deciding  that  it  is 
greater  than  the  true  adjusted  elevation.   Figure  6  shows 
the  expected  value  and  variance  of  the  total  loss  as  a 
function  of  starting  level  for  an  asymmetric  loss  struc- 
ture when  the  value  of  the  loss  parameter  is  50.   Note  the 
trends  in  this  situation.   Procedure  A  varies  widely  depend- 
ing upon  the  starting  level.   Procedure  B  again  appears  to 
be  better  when  the  fire-for-ef feet  phase  starts  away 
from  the  registration  point,  particularly  from  below.   Pro- 
cedure C  is  fairly  consistent  at  about  midway  between  the 
extremes  noted  for  Procedure  A.   Here  also,  Procedures  A 
and/or  B  dominate  Procedure  C  with  respect  to  all  the 
criteria.   Note  that  both  the  expected  value  and  variance 
of  the  total  loss  take  on  larger  values  than  they  did  in 
the  previous  case.   Table  V  shows  the  procedures  which  are 
optimal  under  the  various  criteria  for  the  values  of  n 
considered  when  the  loss  structure  is  asymmetric.   Note 
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Q,  The  Level  at  Which  the  Fire-for-Ef feet  Phase 
Starts  (Spacing  Between  Levels  is  2PE  ) 


Figure  6.   Expected  Value  and  Variance  of  the  Total 
Loss  for  Procedures  A,  B  and  C  as  a  Function 
of  Starting  Level  When  the  Loss  Structure  is 
Asymmetric  and  the  Loss  Parameter  n  is  50. 
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that  in  this  case  the  ordering  is  also  unchanged  for 
n  >  10.   Again  it  is  seen  from  the  data  in  Table  V  that 
Procedure  B  tends  to  be  conservative.   It  is  interesting 
to  observe  that  if  an  asymmetric  loss  structure  is  valid, 
then  the  expected  value  and  variance  of  the  loss  can  be 
greatly  reduced  by  use  of  Procedure  A  and  by  assuring  that 
the  fire-for-ef feet  phase  always  begins  at  a  point  beyond 
the  registration  point. 

In  concluding,  it  should  be  emphasized  that  the  purpose 
of  this  chapter  has  not  been  to  select  an  optimal  elevation 
procedure,  rather  to  show  how  the  current  procedure  can  be 
modeled  and  to  define  its  degree  of  optimality  by  means  of 
comparison  with  some  alternative  procedures.   The  current 
procedure  was  shown  to  be  conservative  under  a  no  loss 
assumption;  that  is,  it  was  found  to  be  a  minimax  procedure 
when  the  basis  of  the  evaluation  and  comparison  was  the 
expected  number  of  rounds  fired  during  the  fire-for-effect 
phase  of  the  registration.   It  was  shown  that  if  a  loss 
structure  exists  and  can  be  represented  by  either  of  the 
loss  functions  h-.  or  h?  for  0  <  n  £  50,  then  the  current 
procedure  is  not  optimal  with  respect  to  any  of  the  criteria 
considered.   In  particular,  if  the  loss  structures  con- 
sidered are  valid,  then  for  n  >  0  the  bio-assay  procedure 
strictly  dominates  the  current  procedure  and  the  old  pro- 
cedure dominates  the  current  procedure  relative  to  prior 

distributions  e.  e  E'  for  i  =  0,  ±1.   These  results 
l  ' 
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suggest  that  further  study  of  the  elevation  procedure  is 
warranted.   Indeed,  it  may  be  possible,  using  the  bio-assay 
procedure,  to  enter  fire-f or-ef feet  more  rapidly  than  is 
currently  the  case. 
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V.   SUMMARY  AND  CONCLUSIONS 

A  class  of  sequential  procedures  for  estimating  the 
mean  of  a  normal  distribution  function  with  known  variance 
from  quantal  response  data  has  been  discussed.   An  experi- 
ment conducted  using  a  procedure  belonging  to  the  class  is 
characterized  by:   1)  a  random  number  of  trials,  2)  a 
number  of  observations  per  trial  that  is  not  necessarily 
constant  throughout  the  experiment,  and  3)  a  sequence  of 
trials  that  are  not  necessarily  performed  successively  at 
equally  spaced  levels.   It  was  seen  that  the  general  pro- 
cedure W(6,  k, ,  k,  ,  C  ),  called  a  modified  Tsutakawa  ran- 
dom walk  design,  depends  upon  the  stopping  rule  6  and  the 
sequences  (k, }  ,  {k,  },  and  {C,}.   The  class  of  general 
procedures  was  seen  to  include  the  up-and-down  method  and 
the  Tsutakawa  random  walk  design  as  special  cases.   Two 
matrices,  the  Procedure  Transition  Matrix  and  the  Procedure 
Iteration  Matrix,  were  found  to  characterize  the  general 
procedure.   A  technique  of  evaluating  the  efficiency  of 
the  general  procedure  was  presented  which  is  essentially 
an  application  of  Wald's  decision  theory.   It  was  seen 
that  a  loss  plus  cost  objective  function  can  be  used  along 
with  one  of  the  four  decision  criteria  discussed  to  deter- 
mine which  among  a  set  of  alternative  procedures  is  best. 
Matrix  equations  for  the  expected  value  and  variance  of 
the  total  loss  were  derived  which  depend  upon  the  a  priori 
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distribution  on  the  starting  level,  the  stopping  rule, 
the  estimator  used  to  determine  the  mean,  and  the  loss 
structure . 

In  the  special  case,  procedures  of  the  form 
W(6,,  k,  0,  1)  were  examined  in  some  detail  for  k  =  1,...,6 
and  a  particular  estimator.   It  was  found  that  choosing  a 
number  k*  of  observations  per  trial  which  minimizes  the 
expected  total  loss  is  equivalent  to  choosing  a  Bayes 
procedure.   It  was  also  found  that  whether  or  not  k*  >  1 
depends  upon  the  magnitude  of  the  loss  which  is  associated 
with  the  decision  that  the  estimated  mean  has  some  value 
other  than  the  true  mean.   In  the  special  case,  it  was 
seen  that  the  choice  of  a  stopping  rule  is  critical  when 
defining  a  set  of  alternative  procedures.   A  rule  that 
stops  the  experiment  too  quickly  may  result  in  comparing 
experiments  which  have  different  sample  sizes. 

Three  alternative  elevation  procedures  for  the  field 
artillery  precision  registration  technique,  used  by  the 
U.S.  Army  and  Marine  Corps  were  discussed  and  compared. 
It  was  seen  that  the  current  procedure  may  be  considered 
optimal  when  there  is  no  loss  associated  with  the  decision 
that  the  adjusted  elevation  has  some  value  other  than  the 
true  adjusted  elevation.   When  there  is  a  loss  associated 
with  this  decision  which  can  be  represented  by  one  of  the 
loss  functions  considered,  it  was  seen  that  Dixon's 
modified  up-and-down  method  strictly  dominates  the  current 
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procedure.   The  author  believes  that  this  result  is  signi- 
ficant and  that  the  up-and-down  method  should  be  further 
evaluated  as  a  candidate  elevation  procedure  for  the 
precision  registration  technique. 

It  appears  that  further  work  in  this  general  area  of 
research  would  be  justified.   In  particular,  it  would  be 
interesting  to  study  the  various  procedures  under  different 
stopping  rules  and  to  investigate  the  effect  of  the  use  of 
various  estimators  and  loss  structures.   It  would  also  be 
of  interest  to  investigate  multivariate  analogs  of  some  of 
the  procedures.   Indeed,  it  may  be  possible  to  model  the 
fire-for-ef feet  phase  of  a  precision  registration  with  a 
two  or  three  dimensional  version  of  the  up-and-down  method. 
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PROCEDURE  TRANSITION  MATRIX 

I-TH  ROW  IS  PROBABILITY  OF  ENDING  AT  LEVEL  J  GIVEN 
THE  EXPERIMENT  STARTS  AT  LEVEL  I 


-2 

-2  0.OR366 

-1  0.03366 

0  0*04433 

♦1  0.040^0 

+  2  0.04040 


-1 

0,45567  0,0 

0,45567  0.0 

0*45567  0,0 

0, 41577  0.0 

0,41577  o,o 


♦  1 


+  ? 


0.41527  0,04040 

0.41527  0.04040 

0.45567  0.04433 

0.45567  0.08866 

0.45567  0.08866 


PPOCEDURF  ITERATION  MATRIX 

I-TH  ROW  IS  PROBABILITY  OF  J  TRIALS  GIVEN 
THE  EXPERIMENT  STARTS  AT  LEVEL  I 


-2 

D0O8866 

0.4^567 

0.41527 

0,040  40 

-1 

0.54433 

0.41527 

0. 04040 

0.0 

C 

0,91134 

0, 08866 

0,0 

0.0 

+  1 

0.544^3 

0.41527 

0,04040 

0,0 

+  7 

0.08866 

0, 45S67 

0.4152  7 

0,04040 

100 


II££_Ll]i5_EiJNLIIDNl__Ll^£AR 


CONDITIONAL    EXPECTED    LOSS    VECTOPS 

I-TH    COMPONENT     IS     cXPEfTED    TOTAL     LOSS    FOR 

ABOVE    TY"E    L^SS     FUNCTION    WHEN    LOSS     PARAMETER     HAS 

VALUE    J    GIVEN    EXPERIMENT    STARTS    AT    LEVEL     I 

0  10  20  30 


-2 

"5.  40741 

14.6980C 

?5,9°8S7 

^73?7Q14 

-1 

2.4^5^7 

1 3.79666 

?5„97724 

35,36731 

0 

.2.  0  3  866 

12.  37526 

23.861  33 

3  4,74  8  4^ 

+  1 

2,49607 

13, 73666 

?5, 07724 

36. 36  784 

+  ? 

3.40741 

14. 69RC0 

25,98857 

37.279]  7 

CONDITIONAL  VARIANCE  VECTORS 

I-TH  COMPONENT  IS  VARIANCE  OF  TOTAL  LOSS  FOR 
ABOVr  TYPE  LOSS  FUNCTION  WHEN  LOSS  °ARAMETF°  HAS 
VALUE  J  GIVEN  EXPERIMENT  STARTS  AT  LEVEL  I 

0  10  '0  30 


_  2 

0.49  95  6 

1C. 53110 

4  3,04419 

98.03931 

-1 

n, 33079 

11.90668 

45„Q6362 

102.,  50293 

0 

0.08080 

9. 77675 

35,63330 

77,64966 

♦  1 

0, 33079 

11.90669 

45.96  362 

102.50073 

♦  2 

0,49056 

10. 53110 

4*. 04419 

98.03687 
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CONDITIONAL  EXPECTED  LOSS  VECTORS 

I-TH  COMPONENT  IS  FXPECTED  TOTAL  LOSS  FOR 

ABOVF  TYPE  LOSS  FUNCTION  WHEN  LOSS  PARAMETER  HAS 

VALUE  J  GIVEN  EXPERIMENT  STARTS  AT  LEVEL  I 

0  10  20  30 


-  2 

3,40741 

17.  27919 

31.15096 

45,02272 

-1 

2. 49607 

16*  36734 

30.23962 

44.11139 

0 

2.03866 

14. 74846 

?7, 4^823 

40,0630^ 

♦  1. 

2.4^607 

16. 36734 

3C.23962 

44,11140 

♦  2 

3.40741 

17.27919 

31,  150°6 

45. 02274 

CONDITIONAL  VARIANCE  VECTORS 

I-TH  COMPONENT  IS  VARIANCE  OF  TOTAL  LOSS  FOR 
ABOVE  TYPE  LOSS  FUNCTION  WHFN  LOSS  PARAMETER  HAS 
VALUE  J  GIVEN  EXPERIMENT  STARTS  AT  LEVEL  I 

0  10  20  3  0 


-2 

n«  49956 

98. 03539 

397, 39966 

QO^. 090*8 

-1 

0.33079 

102.50049 

406.9960O 

913.82007 

o 

0.0303C 

77.64812 

30C. 65479 

669. 10132 

♦  1 

o. 33079 

102. 50049 

406.9Q60Q 

913.31 360 

♦  2 

^.49Q56 

93.0  35*9 

397.89966 

900. 08911 
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PROC BOUOP  TRANSITION  MATPIX 

I-TH  ROW  IS  PROBABILITY  OF  FNDING  AT  LEVEL  J  GIVEN 
THF  PXPPRTMPNT  STARTS  AT  LrVFL  1 


-■? 


-1 


o 


+  1 


+  ? 


-2 

o  ,  007^6 

0.36923 

0,41527 

0, 2060  0 

0,00  163 

-1 

0* 0091 3 

0, ^6706 

0  ,  4  1  c  ?  7 

0 „ 2  060  0 

0,00163 

c 

0,r01 97 

0* 37303 

0, ? c0  00 

C  «  3  7  3  0  ^ 

Co  20  19? 

+  1 

0,00163 

0,20600 

0, 41 627 

0, ^67^6 

0  ■>  00  91  3 

+  2 

0.00163 

0,206  0  0 

0,41  5?7 

9. 36°?3 

0,00786 

PROCEDURE  ITERATION  MATRIX 

I-TH  ROW  IS  PROBABILITY  OF  J  TRIALS  GIVEN 
THF  EXPERIMENT  STARTS  AT  LEVEL  T 


-  ? 

0, 16^46 

0.62291 

0.2  060  0 

o.oc 

:  1 6  3 

- 1 

0.792  3  6 

0. 20600 

0,00163 

0.0 

0 

0, oq607 

0,003^3 

0.0 

O.o 

+1 

0,79236 

0, 20600 

0.00163 

0,0 

+  2 

0. 16946 

0, 62  2  91 

0*  20600 

o.oc 

)163 
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CONDITIONAL  EXPECTED  LOSS  VECTORS 

I-TH  COMPONENT  IS  EX°ECTED  TOTAL  LOSS  FOP 

AROVE  TYPE  LOSS  FUNCTION  WHFN  LOSS  PARAMETER  HAS 

VALUF  J  GIVEN  EXPcRIMFNT  STARTS  AT  LPVEL  I 

n        10        20        30 


-2 

6, 0796  1 

12,02184 

17.96405 

''3,90625 

-1 

4,41853 

10-37346 

16.32837 

2  2. 2  837  8 

0 

4.00786 

11.  54716 

1 9.08646 

26.62575 

+  1 

4.4185* 

10,37345 

16,32837 

27,2*326 

+  ? 

6.07961 

12,02184 

17,96405 

73, 90677 

CONDITIONAL  VARIANCE  VECTORS 

I-TH  COMPONENT  IS  VARIANCE  OF  TOTAL  LOSS  f-HR 
ABUVF  TYPF  LOSS  FUNCTION  WHEN  LOSS  PARAMETER  HAS 
VALUE  J  GIVEN  EXPERIMENT  STARTS  AT  LEVEL  I 

0  10  20  3  0 


-7 

1.  57164 

27.99461 

106,4395° 

737,00635 

-1 

0. 67499 

30,41230 

112.67139 

247.3  9160 

c 

0.01567 

19. 54967 

77. 759?8 

1 740  64551 

♦  1 

0.67499 

30.43231 

112,6713° 

247, 3^258 

*2 

1.52164 

27.99461 

1C6. 48950 

2  37. 0^61 0 

I  nil 
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CONDITIONAL    FXPFCTED    LOSS    VECTORS 

T-TH    CHmoonjcmt     i  <;     EXPECTED    TOTAL     LOSS    FOR 

AB^VE  TYPF  LOSS  FUNCTION  WHFN  j.HSS  PARAMETrR  HAS 

VALOr    J    GIVCN    EXPERIMENT     STARTS    AT    LEV^L     T 


0 


10 


?o 


30 


-  ? 

6, 079S1 

12.21169 

1 t, 34*77 

->*, 47583 

-1 

4,41853 

10,58871 

] 6,  75*90 

2  2*9  290  5 

r. 

4,007-36 

11,  b?576 

19, 24367 

2  6 • 86157 

+  1 

4, 41853 

10, 5  8971 

16,75  890 

22,92905 

+  2 

6,07961 

I2.?1169 

18,34377 

2  4,47583 

COMO  IT  TONAL  VARIANCE  VECTORS 

I-TH  COMPONENT  IS  VARIANCE  OF  TOTAL  LOSS  FOR 
ABOVE  TYPE  LOSS  FUNCTION  WHEN  LOSS  PARAMETER  HAS 
VALUE  J  GIVEN  EXPERIMENT  STARTS  AT  LEVEL  I 


10 


20 


30 


-? 

I,  521c4 

36, 69557 

142,08862 

317.70215 

-1 

0,67490 

40,81877 

154.05493 

340, 3 Q4 77 

c 

0,01567 

7  3, 38771 

92, 4*5^5 

207,30908 

♦  1 

0. 574QQ 

40,81  877 

154,06493 

340,38477 

♦  2 

1.52164 

36,69563 

142,08887 

317,70?15 
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PROCEDURE  TRANSITION  MATRIX 

I-TH  ROW  IS  PROBABILITY  OF  ENDING  AT  LEVEL  J  GIVEN 
THE  FXPERIMFNT  STARTS  AT  LEVEL  I 

-2         -1  0  +1          +  2 

-2    0.00070    0,33701  ^.56768  0.0Q455  0. 0C007 

-I    0,00071    0,16079  0.73^88  0.  0O455  0.00007 

0    0,00009    0.17179  0.65625  0,17170  0,00009 

+  1    0.00007    0,00455  0. 73433  0.16079  0.00071 

+2    0.00007    0„0Q455  0,56768  0.33701  0.^0070 


PROCEDURE  ITERATION  MATRIX 

I-TH  ROW  IS  PROBABILITY  OF  J  TRIALS  GIVEN 
THF  EXPERIMENT  STARTS  AT  LEVEL  T 


-2 

0,24310 

0,66229 

0.00455 

0.00^07 

-1 

0,90539 

0,09455 

0,00007 

0,0 

0 

0.99O83 

0. 00017 

0,0 

n.o 

+  1 

0.90539 

^.09455 

0,00007 

0.0 

+  2 

0.24310 

0. 66229 

0,09455 

0,00007 
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CONDITIONAL  FXPFCTFD  LOSS  VECTPPS 

I-TH  COMPONENT  IS  EXPECTED  TOTAL  LOSS  FOP 

ABOVE  TYPC  LOSS  FUNCTION  WHFN  LOSS  PARAMFTE°  HAS 

VALUE  J  GIVFN  EXPERIMENT  STAPTS  AT  LEVEL  I 

0  10  20  70 


-  7 

9. 5  5474 

12. 88553 

17, 2164? 

21,54726 

-1 

6 • ?  8  403 

5.  94296 

Ho6C1  <*9 

14e 26082 

0 

6,00057 

9.  43^76 

1?, 37900 

16, 31974 

+  1 

6, 7840  3 

8,  ^4296 

I  1  ,60189 

14,26083 

♦  2 

Bo  55474 

1?. 98558 

17, 71642 

21. 54726 

CONDITIONAL  VARIANCE  VECTORS 

I-TH  COMPONENT  IS  VARIANCE  OF  TOTAL  LOSS  FQR 
ABOVE  TYPF  LOSS  FUNCTION  WHFN  LDSS  PARAMETER  HAS 
VALUE  J  GIVEN  EXPERIMENT  STARTS  AT  LEVFL  I 

0  10  20  3  0 


-■? 

2.  84  30^ 

?2»  46559 

91. 49805 

209,°3921 

-1 

^.77266 

24,62582 

8  7.32895 

1 90*33185 

0 

0.301^9 

22. 61777 

°0, 43163 

2r3„ 44360 

+  1 

%  77266 

24,67585 

8  7.82895 

190«39181 

+  7 

7,84300 

2?. 46561 

^1.40805 

209,93^71 
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CONDITIONAL    EXPECTED    LOSS    VECTORS 

I-TH    COMPONENT     IS    EXPECTCD    TOTAL    LOSS    FOR 

AROVE     TYPE    LOSS    FUNCTION    WHEN    LOSS    PARAMETER    HAS 

VALUF     J    GIVFN    EXPERIMENT    STARTS    AT    LEVEL     I 

0  10  20  30 


-? 

<*. 55474 

12.90084 

17. 24693 

21.59303 

-1 

6, 28403 

8.95852 

1 1.63301 

14.30  749 

0 

6.00052 

9.44324 

12,8«597 

16.32869 

+  1 

5. 28403 

8. 9585? 

11.63301 

14,30750 

+  2 

8. 55474 

12.900*4 

17.24693 

21.59303 

CONDITIONAL    VARIANCE    VECTORS 

I-TH    COMPONENT     IS    VARIANCE    OF    TOTAL    LOSS    FOR 
ABOV<=     TYPE     LOSS    FUNCTION    WHFN    LOSS     PARAMETER    HAS 
VALUC    J    GIVEN    EXPERIMENT    STARTS    AT    LEV^L     I 

0  10  20  30 


-2 

2.84300 

23.  19444 

94.52173 

216.82373 

-1 

0. 77266 

25.48325 

91.24463 

198.05663 

0 

0.D015Q 

22.82376 

91.21396 

205.17212 

♦  I 

0. 77?66 

25.48325 

91. 24464 

198.05658 

♦  2 

2.8430C 

23.19444 

c^. 52173 

216.82373 
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PROCEDURE  TRANSITION  MATRIX 

I-TH  ROW  TS  PROBABILITY  OF  FNDING  AT  LEVFL  J  GIVEN 
THE  EXPERIMENT  STARTS  AT  LFVEL  I 

-2         -1          0  +1         +  2 

-2    0,00006    0*35325    0.6G357  C. 04311  0,00000 

-1    0,00007    0,16808    0. 7B87?  0,04311  0.00000 

C    ^»00CO0    0,16406    0*67138  0,16406  0.00000 

+  1    0.00000    0,04311    0.7BR73  0.16808  0.O0O07 

+  2    C.00000    0*04311    0,60357  0,35325  0,00006 


PROCEDURE  ITERATION  MATRIX 

T-TH  ROW  IS  PROBABILITY  OF  J  TRIALS  GIVFM 
THE  EXPERIMENT  STARTS  AT  LFVEL  I 


-2 

0,  31020 

0, 64669 

0.04311 

0.00000 

-1 

0,95639 

0.04311 

0*00000 

0*o 

Q 

Q„ 99Qqq 

0.00001 

0,0 

0,0 

♦1 

0. 95  6  89 

0.04311 

0,00000 

0,0 

+  2 

Oa  31020 

0, 64669 

0,04311 

0,00000 
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CONDITIONAL  EXPECTED  LOSS  VECTORS 

I-TH  COMPONENT  IS  EXPECTEn  TOTAL  LOSS  FOR 

ABOVE  TYPE  LOSS  FUNCTION  WHEN  LOSS  PARAMETER  HAS 

VALUE  J  GIVEN  EXPERIMENT  STARTS  AT  LEVEL  I 

0  10  20  30 


-2 

10, ^3164 

14. 89656 

18.86147 

22,82639 

-1 

fl. 17245 

10.28583 

12.39Q22 

14.51261 

0 

R. 00003 

11. 28135 

1*. 56268 

17.84399 

♦  1 

8.  17245 

10.23584 

12,3^922 

14,51261 

♦  2 

10.93164 

14.89656 

18.86147 

22.826^9 

CONDITIONAL  VARIANCE  VECTORS 

I-TH  COMPONENT  IS  VARIANCE  OF  TOTAL  LOSS  FOR 
ABOVE  TYPE  LOSS  FUNCTION  WHEN  LOSS  PARAMFTER  HAS 
VALUE  J  GIVEN  EXPERIMENT  STARTS  AT  LEVEL  I 

0  10  20  30 

-2  4.51190  15,55380  7^.47876  181,28613 

-1  0.66029  20.06314  72.83037  158.96165 

0  i. 00017  22.04895  88.19308  198.43286 

♦1  0,66029  20.06316  72.83032  158,96159 

♦2  4.51190  15.55379  74, 47876  181.28613 
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CONDITIONAL    EXPFCTEO    LOSS    VECTORS 

I-TH    COMPONENT     IS    EXPECTED    TOTAL    LOSS    FOR 

ABOVE     TYPE    LOSS    FUNCTION    WHEN    LOSS    PARAMFTER    HAS 

VALUE     J    GIVEN    EXPFRIMFNT    STARTS    AT    LEVEL     I 

0  10  ?0  3^ 

-?     10.98164     14,80735     18.86404  22,83025 

-1      8.17245     10,28730     12,4^216  14*5170? 

0      8.00003     11.28151     14.56299  17.34447 

♦  1       3.17245     10.28731     12*40216  14.5170? 

+2     10*93164     14.39785     18.36404  22,83025 


CONDITIONAL  VARIANCE  VECTORS 

I-TH  COMPONENT  IS  VARIANCE  OF  TOTAL  LOSS  FOR 
ABHVF  TYPE  LOSS  FUNCTION  WHEN  LOSS  PAPAMETER  HAS 
VALUE  J  GIVEN  EXPERIMENT  STARTS  AT  LFVFL  I 

0  10  20  30 


-2 

4.51190 

15. 61464 

74, 73462 

1 81.87158 

-1 

0. 66029 

20a 14548 

73,15894 

1 59.700*3 

C 

0.00017 

22.0584^ 

8  8,22352 

198,51050 

♦  1 

0.  66029 

20. 14548 

7  3. 15  889 

159.70052 

♦  2 

4,  51190 

15.6146? 

74„78462 

181.371 58 
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PROCFDURE  TRANSITION  MATRIX 

I-TH  ROW  IS  PROBABILITY  OF  ENDING  AT  L6VFL  J  GIVEN 
THF  EXPERIMENT  STARTS  AT  LEVEL  I 

-2         -1  0  +1         +  2 

-Z         0,00001    0. 39100  0,58935  0.01964  0.00000 

-1    0,00001    0,06786  0.91249  0. Cl°64  0. OOGOO 

0    0.00000    0.07031  0.85938  0.07C31  0,00000 

♦1    0.00000    0,01964  0.9124Q  0.06786  0. 00001 

♦2    0.00000    0.01964  0.58935  0.39100  0.00001 


PROCEDURE  ITERATION  MATRIX 

I-TH  ROW  IS  PROBABILITY  OF  J  TRIALS  GIVEN 
THE  EXPERIMENT  STARTS  AT  LEVEL  I 


-2  0,37136 

-1  0,98035 

0  1.00000 

♦1  0,98035 

+?  0,37136 


0.60900 

0.  01964 

0,00000 

0.01964 

0,00000 

n,o 

C.OOOCO 

0,0 

0.0 

0.01  964 

0.00000 

0,0 

0.60900 

0,01964 

0.00000 
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CONDITIONAL  EXPECTED  LOSS  VECTORS 

T-TH  COMPONENT  IS  EXPECTED  TOTAL  LOSS  En? 

ABOVE  TYPE  LOSS  FUNCTION  WHEN  LOSS  PARAMETER  HAS 

VALUE  J  GIVEN  EXPCRIMFNT  STARTS  AT  LEVEL  I 

0  10  ?"  30 


_  ■? 

1 3, ?4142 

17. 347Q6 

2 1. 45451 

25.561 07 

-1 

10, 099 ?l 

lr, 97338 

11.84855 

12.72372 

n 

10,00000 

LI. 40625 

12*81251 

14.21  8  76 

♦  1 

10.09821 

1  0„  073^P 

11.84855 

12.7237? 

♦  2 

13a 24142 

1 7.34796 

21.^54*! 

2  5,56107 

CONDITIONAL  VARIANCE  VECTORS 

I-TH  COMPONENT  IS  VARIANCE  OF  TOTAL  LHSS  FOR 
ABOVF  TYPE  LOSS  FUNCTION  WHFN  LOSS  PARAMETER  HAS 
VALUF  J  GIVEN  EXPERIMENT  STARTS  AT  LEVEL   I 

0  10  20  ^0 


-2 

6, 68277 

10.  1572^ 

62,03687 

162, 32251 

-1 

0,48161 

10. 26112 

36„m  448 

7  7  „  7  4  1  6  2 

0 

0,noo02 

12.08514 

48, 3^033 

108.76566 

♦  1 

0.48161 

10. 26112 

36.01450 

77,74167 

+  2 

6»68277 

10.  15723 

62.03687 

162,32275 
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CONDITIONAL  EXPECTFD  LOSS  VECTORS 

I-TH  COMPONENT  IS  EXPECTED  TOTAL  LOSS  FOR 

ABOVE  TYPE  LOSS  FUNCTION  WHEN  LOSS  PARAMETER  HAS 

VALUE  J  GIVEN  EXPERIMENT  STARTS  AT  LEVEL  I 

0  10  ?0  30 


-2 

13.24142 

17.34307 

21.45474 

25.56140 

-I 

1C. 09821 

10. 97350 

11.84878 

12.72406 

C 

10,00000 

11.4062* 

12.81252 

14.21*78 

♦  1 

10.09821 

10.97350 

11.34878 

12.72406 

♦  2 

13. 24142 

17.  34807 

21,45474 

25.56140 

CONOITIONAL  VARIANCE  VECTORS 

I-TH  COMPONENT  IS  VARIANCF  OF  TOTAL  LOSS  FOR 
ABOVE  TYPE  LOSS  FUNCTION  WHEN  LOSS  PARAMETER  HAS 
VALUE  J  GIVEN  EXPERIMENT  STARTS  AT  LEVFL  I 

0  10  20  30 


-2 

6.68277 

10. 16260 

62.05859 

162.37280 

-1 

0.48161 

10. 26778 

36.04108 

77.80141 

0 

0,00002 

12.03559 

48.34204 

108.76921 

♦  1 

0.48161 

10. 76779 

36.04108 

77.80147 

♦  2 

6.68277 

10. 16260 

62.05359 

162.373C5 
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PROCEDURE  T»ftNSITinN|  MATRIX 

I-TH  ROW  IS  PROBABILITY  OF  ENDING  AT  LEVEL  J  GIVCN 
THF  EXPERIMENT  STARTS  AT  LEV^L  I 

-2  -1  0         +1  +? 

-?         COOOOO         0,43605  9,555^9         0,00895  0,00000 

-1  0*00000         0,03603  0,90501  0.00S=»5  C.  00000 

0         0.00000         0a07837         0, 343?6         0,07937  0,90000 

+  1         0*00000         0,00895  0,90591  0,08603  0« OOOOO 

+  2  0,00000  ^50^oS  ",55500  0,43605  0.00000 


PROCEDURE     ITERATION    MATRIX 

I-TH    nw    IS    PROBABILITY    OF     J    TRIALS    GIVEN 
THE    EXPERIMENT    STARTS    AT     LEVEL     I 


-?  ^,4?7ro  0,56395  0,00395  n,OrOOO 

-I  0,9910^  9,9^395  0,00000  0,0 

9  1,00000  0.00000  0,9  9,9 

+  1  0,99105  9,9989^  0.  OOOOO  0,9 

+  ?  0,42709  9„55?9^  0.00895  0.00000 
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L*P£_LQ£S_EU!1L11QUJ LINEAR 


CONDITIONAL    EXPECTED    LOSS    VECTORS 

I-TH    COMPONENT     IS    EXPECTED    TOTAL    LOSS    FOR 

ABHVF    TYPF    LOSS    FUNCTION    WHFN    LOSS    PARAMETER    HAS 

VALUE     J    GIVEN    EXPERIMENT    STARTS    AT    LEVEL     I 

D  10  2*  30 

-2  15.49113  19,94110  ?4,39H0  28.84108 

-1  12.05370  13,00355  13.95340  14„90325 

0  11.99999  13.5673*  15,13476  16.70213 

+1  12.05370  13.00355  13.95340  14,90325 

♦  2  15.49U3  19.94110  24.39110  28.84108 


CONDITIONAL    VARIANCE    VECTORS 

I-TH    COMPONFNT     IS    VARIANCE    OF    TOTAL    LOSS    FQR 
ABOVF    TYPE    LOSS    FUNCTION    WHFN    LOSS    PARAMETER    HAS 
VALHF     J    GIVFN    EXPERIMENT    STARTS    AT    LEVEL     I 

0  10  ™  30 


-2 

9,40359 

6.25317 

52.49707 

1^3.13672 

-1 

0, 31961 

9. 88820 

^6. 64963 

80.6033? 

0 

0.00009 

13.21725 

52.86361 

118.95435 

+  1 

0.31O61 

9.33820 

36.64967 

80.6n376 

+  2 

9.40359 

6.25317 

52.49707 

143. 1367? 
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IY£F_LQSS_£U^LIinNu .QiiAQaAIir 


CONDITIONAL    EX^FCTFO    LOSS    VECTORS 

I-TH    COMPQNFNT    IS    EXPECTFD    TOTAL    LOSS    Fr-R 

ABOVF     TYPE    L^SS     FUNCTION    WH-N     LOSS     PARAMETER     HAS 

VAUIF    J    GIVEN    EXPERIMENT    STAPTS    at    LEVEL     I 


-2 

15,49113 

1°.,  °M  1  2 

?4,-»0  1  11 

2  8,34111 

-1 

1  'OS^TG 

13,00356 

13.9  534  2 

14*9n3?8 

o 

i  U  °  9  9  9  9 

13, 567^3 

15„  1  34  76 

1 6,7021 3 

♦  1 

12. 05370 

13,00356 

1 3,95342 

14,90  329 

♦  2 

] 5.49113 

19.0411? 

2  4.  39111 

2  a,  3M.  11 

CONDITIONAL     VA^IANCF     VFCTORS 

I-TH  COMPONENT  IS  VA^TANC^  OF  TnjAL  LOSS  FOR 
ABOVE  TYDF  L^SS  FUNCTION  WHFN  LOSS  PARAMETER  HAS 
VALUF  J  GIVFN  EXPERIMENT  STARTS  AT  LEVEL  I 

0  10  ? 0  30 


-■> 

0,  ^035  9 

6. 25366 

523  49902 

148.14087 

-1 

0.31961 

^, R3892 

36.6  5215 

an, 60045 

0 

0, 0000 a 

13, 31724 

*2*  36  36! 

1 1  8«  05459 

+  1 

0. 3196] 

9  *  8  B  8  8  2 

36,6  5218 

80. 60 9 30 

+  2 

9, 40359 

6. 2  5  366 

5  2.4Q902 

143-14087 
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c 

C      THIS  PRUGRAM  COMPUTES  THE  CONDITIONAL  EXPECTED  LOSS 

C      AND  VARIANCE  OF  THE  LOSS  FOR  PROCEDURES  W(5l,K,0,l) 

C      K=l,...,ft  FOR  A, LINEAR  OR  QUADRATIC  LOSS  FUNCTION 

C      WHERF  THE  RULF  ©n  IS  TO  STOP  WHEN  ROTH  RESPONSES  AND 

C      N  "INRESPONSES  HAVF  BEEN  OBTAINED  AT  TWO  SUCCESSIVE 

C      LEVELS, 

C 

INTEGER  H< 5) ,HSQ(5) 

DIMENSION  N(4) ,NSQ<4) , A<5,5)  ,B(5,4) ,C( 5,51  ,W1(5)  ,W2(5) 
1,W3(5),W4<5>,R(5),RP(5,4),F(5),D(5),V(5),VP(5,4) 
95  FORMAT(hI5) 
190  FORMAT ( • 1'  ,////T56,  'RESULTS  FOR  K  =  ',12/'+', 

1T55, •       •  ) 

?00    F3RMATT//7777,T52",Tt>RClC"E0URE    TRANSITION    MATRIX'/// 
1T38,'I-TH    ROW     IS    PROBABILITY    OF     ENDING    AT    LEVEL    J' 
2TR3, 'GIVEN' //T38,' THE    EXPERIMENT    STARTS    AT    LEVEL     I'/// 
3T47,'-?',8X,'-l',9X,»0',ex,'-H',8X,'  +  2'/// 
4T39, '-2' ,5F10.5//T39,»-1',5F10.5//T40,'G',5F10. 5//T39, 
5'+l',5ir10.  5//T39,'*?'  ,5F10.5) 
205    FQRMAT(////// ,T5?f 'PROCEDURE     ITERATION    MATRIX'/// 
1T43,'I-TH    ROW     IS    PROBABILITY    OF    J    TRIALS    GIVFN'// 
2T43,»THE    EXPERIMENT    STARTS    AT    LEVEL     I'/// 
3T5?,,2»,9X,'3',9X,'^',9X,'5'/// 

4T44, '-2'  ,4F10.5//T44f  >-l«  ,4F10»5//T45,'C',4FK„5//T44, 
5'  +1 • ,4P10. 5//T44, '  +  2'  ,4F10.  5) 
220    EORMATt » 1« ,////T50, 'TYPE    LOSS    FUNCTION:        •) 
2  22    F0RMAT(,+',T71,,LINEAP'/'+«, 

1 T  50 ,  • •  ) 

??3    FORMAT!'  P  ,T7T,'  0UADRAT7C*T7T+T, 

lT50f •  M 

2  30    formaTT7777777T4BTtC"^nditional~e:xF£cteo   LOSS   VECTORS'/ 
1//T39,«I-TH    COMPONENT    IS    EXPECTED    TOTAL    LOSS    FOP'// 
2T39,  'ABOVE     TYPE    LOSS    FUNCTION    WHEN    LOSS    PARAMETER    HAS' 
3//T39,' VALUE    J    GIVEN    EXPERIMENT    STARTS    AT    LEVEL     I'/// 
4T50,'C',10X,'10«,10X,'20',10X,'30'/// 

_.5//T40, »-l',4Fl 
6»+l' ,4F12.5//T40, «+2',4F12.5) 
240  FORMAT! //////  ,T50, 'CONDITIONAL  VARIANCE  VECTORS'/// 
1T39,'I-TH  COMPONENT  IS  VARIANCE  OF  TOTAL  LOSS  FOR'// 
2T39, 'ABOVE  TYPE  LOSS  FUNCTION  WHEN  LOSS  PARAMETER  HAS' 
3//T39,' VALUF  J  GIVEN  EXPERIMENT  STARTS  AT  LEVEL  I'/// 
4T50,  '0'  ,  10X,  '  10  •  »10X,  '2CS  10X,  '30'/// 

5T40,'-2'  ,4F12.5//T4C,'-1'  ,4F1 2. 5//T41 , • C • , 4F12. 5//T40 , 
6'+l' ,4F12.5//T40, '+2' ,4F12.  5) 
C 

C      INPUT  THE  VECTORS  N  AND  NSQ. 
C 

READ(5,95)  (N(  I)  ,  1  =  1  ,4) 
READ(5,  95) (NSQ(  I)  ,1=1 ,4) 
C 

C      K  IS  THE  NUMRER  OF  OBSERVATIONS  PER  TRIAL. 
C 

DO  50  K=l,6 
C 

C      CCMPUT^  A,  B,  AND  C  MATRICES. 
C 

CALL  P»0(K,A,B,C) 
WRITE! 6,190)K 

WRITE(*,2C0H(A(I,J),J  =  1,5),I  =  1,5) 
WRITE(6,20  5M(B(I,JJ,J  =  1,4),I=1,5) 
C 

C      PERFORM  COMPUTATIONS  FOR  TWO  LOSS  FUNCTIONS  USING 
C      FOUR  VALUES  OF  THE  LOSS  PARAMETER. 


C 


DO  5C  1=1,2 
DO  25  J=l,4 


C 

C  THE    FOLLOWING    SUBROUTINES    COMPUTE    THE    VALUES    OF     THE 

C  CCMPCNPNTS    OF    R=AH«-KBN,    THE    CONDITIONAL    LOSS    VECTOR, 

C  AND    STORE     IN    A    MATRIX    FOR    OUTPUT    LATER. 

C 
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CALL  LPSSC I,J,H,HSO) 

call  P^ODH  5,A,H,W1) 

CALL  P«OQ]  (4, H,N,W?  ) 

CAl I  p^OO? (K ,W2,W? ) 

CUL  SUM(W1,W3,») 

r  \LL  TAftLEl ( J,R,kP) 

THf     FOLLOWING    SUBROUTINES    COMMUTE     the-     VALUES    nr     THE 
CTMPHNirNTS     rr    V=C-DIAGONAL    OF    0,     yH?    CONDITIONAL 

vr^iar:  vcctpr,  and  store  in  a  matrix  for  output 

LATFRa 


"01  ( 


C-^LL     Ph 

CHL     P~ 

K  1  =  K  *■  K 

CALL    PS 

C  ALL 

C  A  L  L 

K  1  =  2  • 

CALL 

CALL 

TALL 

K  '  =  -  1 

CALI 

CALL 

CALL 

IF(  J, 

IF(  I..FQ.1,  AW 

Ir<  I  .FQ.2.AN0 

CO  NT  INI  It 


, A ,HSO, «1 ) 
t  BtNSQt W2 I 


)3(K1, W2 ,W3 
SUM(Wl,w3,W4) 
P»f)01  (<3,C,H,W] 

K 

PRO 01 (Kit  W]  ,W? 
SUM(W4  ,W?  tr  ) 
ounn?  ( R,R, WI  ) 

PF  ()0  3  (  K  1  f  Wl  ,  D  ) 

SUM(C  ,r,v) 
TAht  F  1  (  J  ,  V,  V'D  J 


J.f-0,1  )WRIT<-^  ,?<?') 
.|aEw«l)WRITF(6,223) 


•  iijTP'll 

W  »  I  T  F.  < 
W'UTF(: 

STOP 
END 


THF    r 

LOS  So 


MOTIONAL  rXPrCTrO  L 


AND  VARIANCE 


,  2  3  3  )  <  {  K  f>  (  L  ,  M  »  t  M  =  1  ,  4 )  ,  L  =  1 ,  5  ) 
,  ?43H(VP(L,MI,M=1?4),L  =  1,5) 


SL3F  CUT  I 


0(K  ,  A,  H,C J 


THIS    SL=3-'0UTINF     COMPUTES    ELEMENTS 
M^TklCFS,        F(I,N,JI     IS    J  CI  NT    CONDI 
THAT     THT     EXPFRIMFNT     ENDS     AT    L^VFl 
GIVFN     IT     STAPTS     mT     LEVEL    J. 


OF  tuf  A,  b,  AND  C 
T  IONAL  ^F^ARILITY 
I     AFTFP     N    TRIALS 
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TON     F 

=  1-Rr 
T  Al  )  tr 
P  H  A  1  ) 
1  -01 
TAOM 

D  "I 
=  1,5 
=  1  ,4 
=  lt5 
J  )=0 
1  )  =  P  1 

:  )=r  l 

1  l=PO 

i »  =p  r 
1  »  =  p  j 
i  >=p^ 

A  M  MA  ( 

2  )  =  P  1 
2)=F( 
?)=F( 
2)=F( 
?  )=F( 


(?>, 4,5), *(?>  151,8(5,4), c(&f5)tG(3) 
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»Q1*(  l^Pi) 
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=  PC 
=  P  C 
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=  P  i 
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SLBPOUTINE  FACT(N,NF) 

THIS  SUBROUTINE  COMPUTES  N  FACTOPIAl  FOR  INTEGER 
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IFIN.GT.OIGH    TH    20 
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■>  r-     m  r  - 1\|  f  ■:  i\, 
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Gn     jr.     i 


SU*f«    'UT  I  NF     LOSSCN,  JtHfHSQI 
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SU«RCUT INF     PPUP3 (K, At R) 
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SLR^'^UT  I  NE  SU*MA,R,C) 

THIS  SUBROUTINE  SUMS  TWU  VECTORS. 
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SUBROUTINE  TABLF l ( N  ,  A , X ) 
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